Skip to content

[Core] Eliminate parallel worker per-step task scheduling overhead#3763

Closed
njhill wants to merge 6 commits intovllm-project:mainfrom
njhill:streamline-tp
Closed

[Core] Eliminate parallel worker per-step task scheduling overhead#3763
njhill wants to merge 6 commits intovllm-project:mainfrom
njhill:streamline-tp

Commits

Commits on Apr 15, 2024