Skip to content

Commit 13b58e7

Browse files
committed
Raise more exceptions from None in MP engine
This PR is a follow-up to #17800 We should `raise e from None`, otherwise, re-raised error is considered new while processing the original one. Signed-off-by: Vadim Markovtsev <[email protected]>
1 parent 964472b commit 13b58e7

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

vllm/engine/multiprocessing/engine.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -229,8 +229,8 @@ def engine_step(self) -> List[RequestOutput]:
229229
"""Engine step wrapper with error handling."""
230230
try:
231231
return self.engine.step()
232-
except SystemExit:
233-
raise
232+
except SystemExit as e:
233+
raise e from None
234234
except InputProcessingError as e:
235235
# Special case where we handle an error preparing the inputs for
236236
# a single request in the batch
@@ -245,7 +245,7 @@ def engine_step(self) -> List[RequestOutput]:
245245
is_engine_errored=True,
246246
exception=e)
247247
self._send_outputs(rpc_err)
248-
raise e
248+
raise e from None
249249

250250
def handle_new_input(self):
251251
"""Handle new input from the socket"""

0 commit comments

Comments
 (0)