[https://nvbugs/5455836][fix] Fix llama 4 FP4 (NVIDIA#6911)

Signed-off-by: Mike Iovine <[email protected]>
Signed-off-by: Wangshanshan <[email protected]>

Author: mikeiovine

tensorrt_llm/_torch/models/modeling_llama.py

@@ -186,6 +186,9 @@ def _forward_nope(
                                         mrope_config,
                                         attention_sinks=None)
 
+        if isinstance(attn_output, tuple):
+            attn_output = Fp4QuantizedTensor(attn_output[0], attn_output[1])
+
         attn_output = self.o_proj(attn_output,
                                   all_reduce_params=all_reduce_params)