Skip to content

Commit df69d02

Browse files
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
1 parent 4e18ba7 commit df69d02

File tree

1 file changed

+7
-4
lines changed
  • CodeGen/docker_compose/intel/cpu/xeon

1 file changed

+7
-4
lines changed

CodeGen/docker_compose/intel/cpu/xeon/README.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -65,21 +65,24 @@ This uses the default vLLM-based deployment profile (`codegen-xeon-vllm`).
6565

6666
_Note: The compose file might read additional variables from set_env.sh. Ensure all required variables like ports (`LLM_SERVICE_PORT`, `MEGA_SERVICE_PORT`, etc.) are set if not using defaults from the compose file._
6767
like
68+
6869
```
6970
export LLM_MODEL_ID="Qwen/Qwen2.5-Coder-32B-Instruct"
7071
```
72+
7173
can be changed to small model if needed
72-
```
74+
75+
```
7376
export LLM_MODEL_ID="Qwen/Qwen2.5-Coder-7B-Instruct"
74-
```
77+
```
7578

76-
3. **Start Services (vLLM Profile):**
79+
2. **Start Services (vLLM Profile):**
7780

7881
```bash
7982
docker compose --profile codegen-xeon-vllm up -d
8083
```
8184

82-
4. **Validate:**
85+
3. **Validate:**
8386
Wait several minutes for models to download (especially the first time) and services to initialize. Check container logs (`docker compose logs -f <service_name>`) or proceed to the validation steps below.
8487

8588
## Available Deployment Options

0 commit comments

Comments
 (0)