[Question]: Is there a way to set different LLMs for use at indexing vs at retrieval? Right now the only workaround I can think of is to change the LLM model after the indexing process is completed.

[hanafihaffidz]

Do you need to ask a question?

• I have searched the existing question and discussions and this question is not already answered.
• I believe this is a legitimate question, not just a bug or feature request.

Your Question

No response

Additional Context

No response

[danielaskdd]

Your suggestion is excellent. We're considering separating the LLMs for query and indexing operations. This approach would also prevent document indexing from occupying LLM resources, which currently causes unacceptably slow query response times.