We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
chat_format
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi! 👋
I was testing the Server API with Moondream 2 as the model, and the documented chat_format, moondream2, threw an error:
moondream2
Error code: 500 - {'error': {'message': "Invalid chat handler: moondream2 (valid formats: ['llama-2', 'llama-3', 'alpaca', 'qwen', 'vicuna', 'oasst_llama', 'baichuan-2', 'baichuan', 'openbuddy', 'redpajama-incite', 'snoozy', 'phind', 'intel', 'open-orca', 'mistrallite', 'zephyr', 'pygmalion', 'chatml', 'mistral-instruct', 'chatglm3', 'openchat', 'saiga', 'gemma', 'functionary', 'functionary-v2', 'functionary-v1', 'chatml-function-calling'])", 'type': 'internal_server_error', 'param': None, 'code': None}}
Looking at the code, it appears that the correct chat_format is moondream and not moondream2 (moondream worked as expected).
moondream
What do you think?
Let me know if I can open a PR to fix the documented chat_format, please.
Thank you for this project! 😄
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Hi! 👋
I was testing the Server API with Moondream 2 as the model, and the documented
chat_format
,moondream2
, threw an error:Looking at the code, it appears that the correct
chat_format
ismoondream
and notmoondream2
(moondream
worked as expected).What do you think?
Let me know if I can open a PR to fix the documented
chat_format
, please.Thank you for this project! 😄
The text was updated successfully, but these errors were encountered: