Lightweight virtualized private AI stack.
Please refer to https://apps.rancher.io/stacks/suse-ai for the official published charts.
This repo is intended to bring up AI components for demo and development purposes only.
At it's core, the stack is consist of the following:
- SUSE Linux Enterprise Server 15SP6 virtual machine (VM)
- Rancher RKE2 Kubernetes distribution
- Rancher Prime Kubernetes manager
- Ollama LLM platform
- Open WebUI, front-end for Ollama
- [Milvus][milvus], Vector DB for AI stack
The stack is self-contained, designed to run on a local environment. However, it can also be running in AWS if the local environment lacks the required hardware resource.
For information on how to setup the Private AI stack on the local environment, please see Local Setup.
For information on how to setup the Private AI stack on the local environment, please see AWS Setup.