Skip to content

Commit 46594df

Browse files
Disable prefix caching only if chunked prefill is explicitly disabled
Signed-off-by: simondanielsson <[email protected]>
1 parent a5f9cae commit 46594df

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/config/__init__.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@
2525
from vllm.config.speculative import SpeculativeConfig
2626
from vllm.config.speech_to_text import SpeechToTextConfig
2727
from vllm.config.structured_outputs import StructuredOutputsConfig
28+
<<<<<<< HEAD
2829
from vllm.config.utils import (ConfigType, SupportsMetricsInfo, config,
2930
get_attr_docs, is_init_field, update_config)
3031
from vllm.config.vllm import (VllmConfig, get_cached_compilation_config,

0 commit comments

Comments
 (0)