Skip to content

Commit 465968b

Browse files
authored
Fix dtype error in CI (#8197)
1 parent 750838a commit 465968b

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • python/sglang/srt/layers/moe

python/sglang/srt/layers/moe/topk.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -524,7 +524,7 @@ def biased_grouped_topk_gpu(
524524
topk_weights = torch.empty((token, topk), dtype=torch.float32, device=device)
525525
topk_ids = torch.empty((token, topk), dtype=torch.int32, device=device)
526526
aiter_biased_grouped_topk(
527-
gating_output,
527+
gating_output.to(dtype=torch.float32),
528528
correction_bias,
529529
topk_weights,
530530
topk_ids,

0 commit comments

Comments
 (0)