Skip to content

Wrong chat_format documented for Moondream 2 #1996

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
joaopalmeiro opened this issue Apr 9, 2025 · 0 comments
Open

Wrong chat_format documented for Moondream 2 #1996

joaopalmeiro opened this issue Apr 9, 2025 · 0 comments

Comments

@joaopalmeiro
Copy link

joaopalmeiro commented Apr 9, 2025

Hi! 👋

I was testing the Server API with Moondream 2 as the model, and the documented chat_format, moondream2, threw an error:

Error code: 500 - {'error': {'message': "Invalid chat handler: moondream2 (valid formats: ['llama-2', 'llama-3', 'alpaca', 'qwen', 'vicuna', 'oasst_llama', 'baichuan-2', 'baichuan', 'openbuddy', 'redpajama-incite', 'snoozy', 'phind', 'intel', 'open-orca', 'mistrallite', 'zephyr', 'pygmalion', 'chatml', 'mistral-instruct', 'chatglm3', 'openchat', 'saiga', 'gemma', 'functionary', 'functionary-v2', 'functionary-v1', 'chatml-function-calling'])", 'type': 'internal_server_error', 'param': None, 'code': None}}

Looking at the code, it appears that the correct chat_format is moondream and not moondream2 (moondream worked as expected).

What do you think?

Let me know if I can open a PR to fix the documented chat_format, please.

Thank you for this project! 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant