[Bugfix] Fix #7592 vllm 0.5.4 enable_chunked_prefill throughput is slightly lower than 0.5.3~0.5.0.#7874
Merged
youkaichao merged 2 commits intovllm-project:mainfrom Sep 2, 2024
Merged
Commits
Commits on Aug 30, 2024
Commits on Aug 31, 2024
- committed