Skip to content

Commit 8478933

Browse files
committed
🐛 add dead_error property to engine cllient
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
1 parent e18749f commit 8478933

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

vllm/engine/multiprocessing/client.py

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -380,6 +380,13 @@ def is_stopped(self) -> bool:
380380
def errored(self) -> bool:
381381
return self._errored_with is not None
382382

383+
@property
384+
def dead_error(self) -> BaseException:
385+
if self._errored_with is not None:
386+
return ENGINE_DEAD_ERROR(self._errored_with)
387+
else:
388+
return ENGINE_DEAD_ERROR()
389+
383390
async def generate(
384391
self,
385392
inputs: PromptInputs,

0 commit comments

Comments
 (0)