Skip to content

Commit 545aa57

Browse files
authored
[ChatQnA] Update Benchmark E2E Parameters (#1200)
Signed-off-by: letonghan <letong.han@intel.com>
1 parent 5422bcb commit 545aa57

File tree

2 files changed

+3
-7
lines changed

2 files changed

+3
-7
lines changed

ChatQnA/benchmark/performance/kubernetes/intel/gaudi/README.md

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -146,7 +146,6 @@ Before testing, upload a specified file to make sure the llm input have the toke
146146
Get files:
147147

148148
```bash
149-
wget https://github.com/opea-project/GenAIEval/tree/main/evals/benchmark/data/upload_file_no_rerank.txt
150149
wget https://github.com/opea-project/GenAIEval/tree/main/evals/benchmark/data/upload_file.txt
151150
```
152151

@@ -164,14 +163,10 @@ Use the following `cURL` command to upload file:
164163

165164
```bash
166165
cd GenAIEval/evals/benchmark/data
167-
# RAG with Rerank
168166
curl -X POST "http://${cluster_ip}:6007/v1/dataprep" \
169167
-H "Content-Type: multipart/form-data" \
168+
-F "chunk_size=3800" \
170169
-F "files=@./upload_file.txt"
171-
# RAG without Rerank
172-
curl -X POST "http://${cluster_ip}:6007/v1/dataprep" \
173-
-H "Content-Type: multipart/form-data" \
174-
-F "files=@./upload_file_no_rerank.txt"
175170
```
176171

177172
#### Run Benchmark Test

ChatQnA/benchmark/performance/kubernetes/intel/gaudi/benchmark.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ test_cases:
3737
service_name: "chatqna-retriever-usvc" # Replace with your service name
3838
parameters:
3939
search_type: "similarity"
40-
k: 4
40+
k: 1
4141
fetch_k: 20
4242
lambda_mult: 0.5
4343
score_threshold: 0.2
@@ -65,3 +65,4 @@ test_cases:
6565
e2e:
6666
run_test: true
6767
service_name: "chatqna" # Replace with your service name
68+
k: 1

0 commit comments

Comments
 (0)