Skip to content

[Core] Multiprocessing executor for single-node multi-GPU deployment#3466

Closed
njhill wants to merge 8 commits intovllm-project:mainfrom
njhill:ray-optional2
Closed

[Core] Multiprocessing executor for single-node multi-GPU deployment#3466
njhill wants to merge 8 commits intovllm-project:mainfrom
njhill:ray-optional2

Commits

Commits on Apr 15, 2024