Skip to content

Commit 6af5ff4

Browse files
Chingis YundunovChingis Yundunov
Chingis Yundunov
authored and
Chingis Yundunov
committed
DBQnA - fix test script for deploy application on AMD
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
1 parent 277d8cb commit 6af5ff4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

DBQnA/docker_compose/amd/gpu/rocm/compose.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ services:
2929
security_opt:
3030
- seccomp:unconfined
3131
ipc: host
32-
command: --model-id ${MODEL_ID}
32+
command: --model-id ${MODEL_ID} --max-input-length 2048 --max-total-tokens 4096
3333

3434
postgres:
3535
image: postgres:latest

0 commit comments

Comments
 (0)