Skip to content

Commit 6374a27

Browse files
fzyzcjyChangyiYang
authored andcommitted
Overlap two kernels in DeepSeek with communication (sgl-project#6711)
1 parent 1a55a95 commit 6374a27

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

python/sglang/srt/operations_strategy.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,9 +127,9 @@ def _compute_moe_deepseek_blog_decode(layer):
127127
layer.mlp.op_combine_a,
128128
operations.YieldOperation(),
129129
layer.mlp.op_combine_b,
130+
operations.YieldOperation(),
130131
layer.mlp.op_output,
131132
layer.op_comm_postprocess_layer,
132-
operations.YieldOperation(),
133133
],
134134
)
135135

0 commit comments

Comments
 (0)