Skip to content

Commit d3d91b6

Browse files
reidliu41reidliu41
and
reidliu41
authored
[Misc][MacOS] fix bfloat16 error (#18249)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
1 parent 87d8714 commit d3d91b6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/platforms/cpu.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ def supported_dtypes(self) -> list:
3636
# instead of checking the OS. For instance M2 shall supports bf16
3737
# already. But we need to modify `cpu_extension.cmake` to activate
3838
# the feature in the build.
39-
return [torch.bfloat16, torch.float32]
39+
return [torch.float16, torch.float32]
4040
# x86/aarch64 CPU has supported both bf16 and fp16 natively.
4141
return [torch.bfloat16, torch.float16, torch.float32]
4242

0 commit comments

Comments
 (0)