Skip to content

Commit 24f4ff0

Browse files
feat: install tensorizer in the UBI image (vllm-project#36)
Install ~libsodium and~ tensorizer in UBI image --------- Signed-off-by: Travis Johnson <[email protected]>
1 parent 3dc2819 commit 24f4ff0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Dockerfile.ubi

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -235,7 +235,7 @@ ENV PATH=/opt/vllm/bin/:$PATH
235235
# install vllm wheel first, so that torch etc will be installed
236236
RUN --mount=type=bind,from=build,src=/workspace/dist,target=/workspace/dist \
237237
--mount=type=cache,target=/root/.cache/pip \
238-
pip install dist/*.whl --verbose
238+
pip install $(echo dist/*.whl)'[tensorizer]' --verbose
239239

240240
# Install the vllm_nccl package which is a bit quirky
241241
RUN --mount=type=cache,target=/root/.cache/pip \

0 commit comments

Comments
 (0)