[Bugfix] adding chunking mechanism to fused_moe to handle large inputs#6029
Merged
comaniac merged 10 commits intovllm-project:mainfrom Jul 1, 2024
avshalomman:main
Merged
[Bugfix] adding chunking mechanism to fused_moe to handle large inputs#6029comaniac merged 10 commits intovllm-project:mainfrom avshalomman:main
comaniac merged 10 commits intovllm-project:mainfrom
avshalomman:main
Commits
Commits on Jul 1, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
