Skip to content

Fix prefix caching is currently not supported with sliding window attention when using qwen1.5#3377

Closed
carrey-feng wants to merge 12 commits intovllm-project:mainfrom
carrey-feng:add_judgment_for_use_sliding_window
Closed

Fix prefix caching is currently not supported with sliding window attention when using qwen1.5#3377
carrey-feng wants to merge 12 commits intovllm-project:mainfrom
carrey-feng:add_judgment_for_use_sliding_window

Commits

Commits on Mar 14, 2024