Skip to content

Commit f69aee3

Browse files
committed
IQ2_K quantization works
1 parent c90504e commit f69aee3

File tree

2 files changed

+644
-1
lines changed

2 files changed

+644
-1
lines changed

ggml/src/ggml.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1397,7 +1397,7 @@ static const struct ggml_type_traits type_traits[GGML_TYPE_COUNT] = {
13971397
// .vec_dot = vec_dot_iq2_k_q8_k,
13981398
// .vec_dot_type = GGML_TYPE_Q8_K,
13991399
// .nrows = 1,
1400-
.row_meta_size = 2,
1400+
.row_meta_size = 0,
14011401
},
14021402
[GGML_TYPE_IQ2_K_R4] = {
14031403
.type_name = "iq2_k_r4",

0 commit comments

Comments
 (0)