Skip to content

[v1][KVCacheManager] Avoid full cache hit by controlling max_length#17999

Merged
WoosukKwon merged 4 commits intovllm-project:mainfrom
heheda12345:last_block
May 13, 2025
Merged

[v1][KVCacheManager] Avoid full cache hit by controlling max_length#17999
WoosukKwon merged 4 commits intovllm-project:mainfrom
heheda12345:last_block

Commits

Commits on May 12, 2025

Commits on May 13, 2025