Skip to content

Commit 29b6e9a

Browse files
committed
fix: wrong parameter for flash attention in pickle __getstate__
1 parent 22d77ee commit 29b6e9a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llama_cpp/llama.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1777,7 +1777,7 @@ def __getstate__(self):
17771777
logits_all=self.context_params.logits_all,
17781778
embedding=self.context_params.embeddings,
17791779
offload_kqv=self.context_params.offload_kqv,
1780-
flash_offload=self.context_params.flash_offload,
1780+
flash_attn=self.context_params.flash_attn,
17811781
# Sampling Params
17821782
last_n_tokens_size=self.last_n_tokens_size,
17831783
# LoRA Params

0 commit comments

Comments
 (0)