Skip to content

Commit 3400465

Browse files
joerundesumitd2
authored andcommitted
[Bugfix] add dead_error property to engine client (vllm-project#8574)
Signed-off-by: Joe Runde <[email protected]> Signed-off-by: Sumit Dubey <[email protected]>
1 parent 7032df1 commit 3400465

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

vllm/engine/multiprocessing/client.py

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -380,6 +380,13 @@ def is_stopped(self) -> bool:
380380
def errored(self) -> bool:
381381
return self._errored_with is not None
382382

383+
@property
384+
def dead_error(self) -> BaseException:
385+
if self._errored_with is not None:
386+
return ENGINE_DEAD_ERROR(self._errored_with)
387+
else:
388+
return ENGINE_DEAD_ERROR()
389+
383390
async def generate(
384391
self,
385392
inputs: PromptInputs,

0 commit comments

Comments
 (0)