You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Could you please add a model registry? This would allow us to import multiple models from various sources in different formats supported by MAX, including from a local path, into a centralized system-hosted (cached) registry. We could then serve these models directly from the registry.
What is your motivation for this change?
This feature would be incredibly useful for consolidating all my LLMs in one place (or registry) and enabling me to download specific models to multiple nodes from that registry.
What is your request?
Could you please add a model registry? This would allow us to import multiple models from various sources in different formats supported by MAX, including from a local path, into a centralized system-hosted (cached) registry. We could then serve these models directly from the registry.
What is your motivation for this change?
This feature would be incredibly useful for consolidating all my LLMs in one place (or registry) and enabling me to download specific models to multiple nodes from that registry.
This is also can help with #4129 issue
Any other details?
Maybe ollama's approach on model registry is a great way to handle this.
The text was updated successfully, but these errors were encountered: