I can't understand how to run this line ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2 #923
Unanswered
SCHIZ0FRENIA
asked this question in
Q&A
Replies: 1 comment
-
|
The second one should be correct. What errors are you getting? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I called it like this
python3 ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2
Like this
./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2
but nothing works, please help me.
Beta Was this translation helpful? Give feedback.
All reactions