You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. update modelslim version to fix deepseek related issues
2. add note for "--quantization ascend"
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
@@ -68,6 +68,10 @@ The converted model files looks like:
68
68
```
69
69
70
70
Run the following script to start the vLLM server with quantize model:
71
+
72
+
:::{note}
73
+
The value "ascend"for"--quantization" argument will be supported after [a specific PR](https://github.com/vllm-project/vllm-ascend/pull/877) is merged and released, you can cherry-pick this commit for now.
0 commit comments