File tree 1 file changed +2
-2
lines changed
src/distilabel/steps/tasks/magpie
1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change 31
31
32
32
MAGPIE_MULTI_TURN_SYSTEM_PROMPT = (
33
33
"You are a helpful Al assistant. The user will engage in a multi−round conversation"
34
- " with you,asking initial questions and following up with additional related questions."
34
+ " with you, asking initial questions and following up with additional related questions."
35
35
" Your goal is to provide thorough, relevant and insightful responses to help the user"
36
36
" with their queries."
37
37
)
@@ -177,7 +177,7 @@ class Magpie(Task, MagpieBase):
177
177
fine-tuned LLMs. As they were fine-tuned using a chat template composed by a user message
178
178
and a desired assistant output, the instruct fine-tuned LLM learns that after the pre-query
179
179
or pre-instruct tokens comes an instruction. If these pre-query tokens are sent to the
180
- LLM without any user message, then the LLM will continue generating tokens as it was
180
+ LLM without any user message, then the LLM will continue generating tokens as if it was
181
181
the user. This trick allows "extracting" instructions from the instruct fine-tuned LLM.
182
182
After this instruct is generated, it can be sent again to the LLM to generate this time
183
183
an assistant response. This process can be repeated N times allowing to build a multi-turn
You can’t perform that action at this time.
0 commit comments