Skip to content

Commit 9499dce

Browse files
authored
Use fork for worker multiprocessing method (vllm-project#29)
It's faster Signed-off-by: Nick Hill <[email protected]>
1 parent 6b06bf0 commit 9499dce

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

Dockerfile.ubi

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -268,7 +268,8 @@ ENV HF_HUB_OFFLINE=1 \
268268
PORT=8000 \
269269
GRPC_PORT=8033 \
270270
HOME=/home/vllm \
271-
VLLM_USAGE_SOURCE=production-docker-image
271+
VLLM_USAGE_SOURCE=production-docker-image \
272+
VLLM_WORKER_MULTIPROC_METHOD=fork
272273

273274
# setup non-root user for OpenShift
274275
RUN microdnf install -y shadow-utils \

0 commit comments

Comments
 (0)