Skip to content

[Core][Distributed] support both cpu and device tensor in broadcast tensor dict#4660

Merged
youkaichao merged 3 commits intovllm-project:mainfrom
youkaichao:split_broadcast
May 8, 2024
Merged

[Core][Distributed] support both cpu and device tensor in broadcast tensor dict#4660
youkaichao merged 3 commits intovllm-project:mainfrom
youkaichao:split_broadcast

Commits

Commits on May 7, 2024