File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -14,17 +14,17 @@ helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUG
14
14
15
15
```
16
16
export HFTOKEN="insert-your-huggingface-token-here"
17
- helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-values.yaml
17
+ helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-vllm- values.yaml
18
18
```
19
19
20
20
## Deploy variants of ChatQnA
21
21
22
22
ChatQnA is configurable and you can enable/disable features by providing values.yaml file.
23
- For example, to run with vllm instead of tgi on Gaudi hardware, use gaudi-vllm -values.yaml file:
23
+ For example, to run with tgi instead of vllm inference engine on Gaudi hardware, use gaudi-tgi -values.yaml file:
24
24
25
25
```
26
26
export HFTOKEN="insert-your-huggingface-token-here"
27
- helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-vllm -values.yaml
27
+ helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-tgi -values.yaml
28
28
```
29
29
30
30
See other * -values.yaml files in this directory for more reference.
You can’t perform that action at this time.
0 commit comments