Skip to content

[MISC] Keep chunked prefill enabled by default with long context when prefix caching is enabled#8342

Merged
comaniac merged 1 commit intovllm-project:mainfrom
comaniac:keep_cp_enable
Sep 10, 2024
Merged

[MISC] Keep chunked prefill enabled by default with long context when prefix caching is enabled#8342
comaniac merged 1 commit intovllm-project:mainfrom
comaniac:keep_cp_enable

Commits

Commits on Sep 10, 2024