Skip to content

Commit a6c3949

Browse files
darthhexxsumitd2
authored andcommitted
[Bugfix] Ray 2.9.x doesn't expose available_resources_per_node (vllm-project#8767)
Signed-off-by: darthhexx <darthhexx@gmail.com> Signed-off-by: Sumit Dubey <sumit.dubey2@ibm.com>
1 parent e0be395 commit a6c3949

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

vllm/executor/ray_utils.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,14 @@
1818

1919
try:
2020
import ray
21-
from ray._private.state import available_resources_per_node
2221
from ray.util import placement_group_table
2322
from ray.util.placement_group import PlacementGroup
23+
try:
24+
from ray._private.state import available_resources_per_node
25+
except ImportError:
26+
# Ray 2.9.x doesn't expose `available_resources_per_node`
27+
from ray._private.state import state as _state
28+
available_resources_per_node = _state._available_resources_per_node
2429

2530
class RayWorkerWrapper(WorkerWrapperBase):
2631
"""Ray wrapper for vllm.worker.Worker, allowing Worker to be

0 commit comments

Comments
 (0)