[Bugfix][Model] OLMo 2: split qkv correctly for GQA and MQA#13687
Merged
simon-mo merged 1 commit intovllm-project:mainfrom Feb 22, 2025
Merged
[Bugfix][Model] OLMo 2: split qkv correctly for GQA and MQA#13687simon-mo merged 1 commit intovllm-project:mainfrom
simon-mo merged 1 commit intovllm-project:mainfrom
