Skip to content

Commit 998d208

Browse files
authored
More checks before assuming FIM tokens for Llama arch
1 parent db10f01 commit 998d208

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llama.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4330,7 +4330,7 @@ static void llm_load_vocab(
43304330
[](unsigned char c){ return std::tolower(c); });
43314331

43324332
if (gen_name.find("code") != std::string::npos) {
4333-
if (model.arch == LLM_ARCH_LLAMA) {
4333+
if (model.arch == LLM_ARCH_LLAMA && gen_name.find("llama") != std::string::npos) {
43344334
vocab.special_prefix_id = 32007;
43354335
vocab.special_suffix_id = 32008;
43364336
vocab.special_middle_id = 32009;

0 commit comments

Comments
 (0)