Skip to content

Commit 3b2e176

Browse files
committed
Add extra deps for openai server image
1 parent 01b6f9e commit 3b2e176

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -202,7 +202,7 @@ FROM vllm-base AS vllm-openai
202202

203203
# install additional dependencies for openai api server
204204
RUN --mount=type=cache,target=/root/.cache/pip \
205-
pip install accelerate hf_transfer 'modelscope!=1.15.0'
205+
pip install accelerate hf_transfer 'modelscope!=1.15.0' bitsandbytes>=0.44.0 timm==0.9.10
206206

207207
ENV VLLM_USAGE_SOURCE production-docker-image
208208

0 commit comments

Comments
 (0)