Skip to content

Commit 9b76d87

Browse files
committed
Improve exception reporting in MP engine
"raise e from None" means changing the error bubble narrative from "another exception caused by e" to "exception e was raised and we forward it up" Signed-off-by: Vadim Markovtsev <vadim@poolside.ai>
1 parent 7377dd0 commit 9b76d87

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/engine/multiprocessing/engine.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -284,7 +284,7 @@ def handle_new_input(self):
284284
except Exception as e:
285285
self._set_errored(e)
286286
self._send_unhealthy(e)
287-
raise e
287+
raise e from None
288288

289289
def _handle_process_request(self, request: RPCProcessRequest):
290290
"""Handle RPCProcessRequest by adding it to the LLMEngine."""
@@ -447,4 +447,4 @@ def run_mp_engine(vllm_config: VllmConfig, usage_context: UsageContext,
447447
except BaseException as e:
448448
logger.exception(e)
449449
engine_alive.value = False
450-
raise e
450+
raise e from None

0 commit comments

Comments
 (0)