Skip to content

Commit 2a4db29

Browse files
Isotr0pymawong-amd
authored andcommitted
[Bugfix][CPU] Fix broken AVX2 CPU TP support (vllm-project#17252)
Signed-off-by: Isotr0py <2037008807@qq.com>
1 parent b677175 commit 2a4db29

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/distributed/device_communicators/cpu_communicator.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,8 @@ def __init__(self,
2222
super().__init__(cpu_group, device, device_group, unique_name)
2323
self.dist_module = torch.distributed
2424

25-
if current_platform.get_cpu_architecture() == CpuArchEnum.X86:
25+
if (current_platform.get_cpu_architecture() == CpuArchEnum.X86) \
26+
and hasattr(torch.ops._C, "init_shm_manager"):
2627
self.dist_module = _CPUSHMDistributed(self)
2728

2829
def all_reduce(self, input_):

0 commit comments

Comments
 (0)