Skip to content

Commit 1b8cf77

Browse files
authored
[Fix] incorrect assert in EPLB (#7575)
1 parent bb9b608 commit 1b8cf77

1 file changed

Lines changed: 0 additions & 4 deletions

File tree

python/sglang/srt/managers/expert_distribution.py

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -479,10 +479,6 @@ def __init__(self, *args, **kwargs):
479479
def on_select_experts(self, layer_idx: int, topk_ids: torch.Tensor):
480480
topk_ids = topk_ids.flatten()
481481
mask = topk_ids != -1
482-
assert self._data[layer_idx, :].shape == topk_ids.shape, (
483-
"Shape mismatch between data and topk_ids."
484-
"Selecting expert is not supported for multiple token prediction at the moment."
485-
)
486482
self._data[layer_idx, :].scatter_add_(
487483
dim=0, index=topk_ids.masked_fill(~mask, 0).long(), src=mask.int()
488484
)

0 commit comments

Comments
 (0)