Skip to content

Commit f1a87bf

Browse files
authored
fix mori fp8 issue (vllm-project#31)
1 parent 716a17a commit f1a87bf

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1021,6 +1021,7 @@ def apply(
10211021
) = self.mori_op.dispatch(x, topk_weights, scale, topk_ids)
10221022
else:
10231023
dispatch_weights = topk_weights
1024+
dispatch_scale = None
10241025
dispatch_ids = topk_ids
10251026
dispatch_recv_token_num = None
10261027
dtype = None

0 commit comments

Comments
 (0)