Skip to content

Commit 69db16a

Browse files
authored
add platform check back (#15578)
Signed-off-by: Chenyaaang <[email protected]>
1 parent ce78f9a commit 69db16a

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vllm/v1/engine/processor.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -137,6 +137,9 @@ def _validate_structured_output(self, params: SamplingParams) -> None:
137137
f" != {engine_level_backend}")
138138
else:
139139
params.guided_decoding.backend = engine_level_backend
140+
import vllm.platforms
141+
if vllm.platforms.current_platform.is_tpu():
142+
raise ValueError("Structured output is not supported on TPU.")
140143

141144
# Request content validation
142145

0 commit comments

Comments
 (0)