Skip to content

Commit c5c1d71

Browse files
authored
fix qkv split when head_dim is 0
1 parent 35782ae commit c5c1d71

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5175,7 +5175,7 @@ def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iter
51755175
n_head = self.hparams["num_attention_heads"]
51765176
n_kv_head = self.hparams.get("num_key_value_heads")
51775177
n_embd = self.hparams["hidden_size"]
5178-
head_dim = self.hparams.get("head_dim", n_embd // n_head)
5178+
head_dim = self.hparams.get("head_dim") or n_embd // n_head
51795179

51805180
output_name = self.format_tensor_name(gguf.MODEL_TENSOR.OUTPUT)
51815181

0 commit comments

Comments
 (0)