Skip to content

Commit 4f0e0ea

Browse files
authored
Add FlashInfer to default Dockerfile (#6172)
1 parent ddc369f commit 4f0e0ea

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

Dockerfile

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -167,6 +167,9 @@ RUN --mount=type=bind,from=build,src=/workspace/dist,target=/vllm-workspace/dist
167167
RUN --mount=type=bind,from=mamba-builder,src=/usr/src/mamba,target=/usr/src/mamba \
168168
--mount=type=cache,target=/root/.cache/pip \
169169
python3 -m pip install /usr/src/mamba/*.whl --no-cache-dir
170+
171+
RUN --mount=type=cache,target=/root/.cache/pip \
172+
python3 -m pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.0.8/flashinfer-0.0.8+cu121torch2.3-cp310-cp310-linux_x86_64.whl
170173
#################### vLLM installation IMAGE ####################
171174

172175

0 commit comments

Comments
 (0)