Skip to content

Commit f767b29

Browse files
authored
Merge pull request #722 from relyt0925/fix-shm-size
Add environment variables for ilab container and increase shm size for vllm
2 parents 7eae618 + ea64b86 commit f767b29

File tree

1 file changed

+4
-0
lines changed
  • training/ilab-wrapper

1 file changed

+4
-0
lines changed

training/ilab-wrapper/ilab

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,11 +76,15 @@ PODMAN_COMMAND=("sudo" "podman" "run" "--rm" "-it"
7676
"${IMPERSONATE_CURRENT_USER_PODMAN_FLAGS[@]}"
7777
"--device" "${CONTAINER_DEVICE}"
7878
"--security-opt" "label=disable" "--net" "host"
79+
"--shm-size" "10G"
7980
"-v" "$HOME:$HOME"
8081
"${ADDITIONAL_MOUNT_OPTIONS[@]}"
8182
# This is intentionally NOT using "--env" "HOME" because we want the HOME
8283
# of the current shell and not the HOME set by sudo
8384
"--env" "HOME=$HOME"
85+
"--env" "ILAB_GLOBAL_CONFIG=$ILAB_GLOBAL_CONFIG"
86+
"--env" "VLLM_LOGGING_LEVEL=$VLLM_LOGGING_LEVEL"
87+
"--env" "NCCL_DEBUG=$NCCL_DEBUG"
8488
"--entrypoint" "$ENTRYPOINT"
8589
"--env" "HF_TOKEN"
8690
"${IMAGE_NAME}")

0 commit comments

Comments
 (0)