Skip to content

Commit 2ce9553

Browse files
ElizaWszolaxuebwang-amd
authored andcommitted
[Compiler] Disable Inductor standalone compile by default (vllm-project#25391)
Signed-off-by: ElizaWszola <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>
1 parent ddb7e46 commit 2ce9553

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/envs.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -126,6 +126,7 @@
126126
VLLM_DP_RANK: int = 0
127127
VLLM_DP_RANK_LOCAL: int = -1
128128
VLLM_DP_SIZE: int = 1
129+
VLLM_USE_STANDALONE_COMPILE: bool = False
129130
VLLM_DP_MASTER_IP: str = ""
130131
VLLM_DP_MASTER_PORT: int = 0
131132
VLLM_MOE_DP_CHUNK_SIZE: int = 256
@@ -437,9 +438,9 @@ def get_vllm_port() -> Optional[int]:
437438

438439
# Feature flag to enable/disable Inductor standalone compile.
439440
# In torch <= 2.7 we ignore this flag; in torch >= 2.8 this is
440-
# enabled by default.
441+
# disabled by default.
441442
"VLLM_USE_STANDALONE_COMPILE":
442-
lambda: os.environ.get("VLLM_USE_STANDALONE_COMPILE", "1") == "1",
443+
lambda: os.environ.get("VLLM_USE_STANDALONE_COMPILE", "0") == "1",
443444

444445
# local rank of the process in the distributed setting, used to determine
445446
# the GPU device id

0 commit comments

Comments
 (0)