Skip to content

Commit 4e18ba7

Browse files
authored
Update README.md for
1 parent a43c7db commit 4e18ba7

File tree

1 file changed

+7
-3
lines changed
  • CodeGen/docker_compose/intel/cpu/xeon

1 file changed

+7
-3
lines changed

CodeGen/docker_compose/intel/cpu/xeon/README.md

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -65,17 +65,21 @@ This uses the default vLLM-based deployment profile (`codegen-xeon-vllm`).
6565

6666
_Note: The compose file might read additional variables from set_env.sh. Ensure all required variables like ports (`LLM_SERVICE_PORT`, `MEGA_SERVICE_PORT`, etc.) are set if not using defaults from the compose file._
6767
like
68+
```
6869
export LLM_MODEL_ID="Qwen/Qwen2.5-Coder-32B-Instruct"
69-
can be change to small model if needed
70+
```
71+
can be changed to small model if needed
72+
```
7073
export LLM_MODEL_ID="Qwen/Qwen2.5-Coder-7B-Instruct"
74+
```
7175

72-
2. **Start Services (vLLM Profile):**
76+
3. **Start Services (vLLM Profile):**
7377

7478
```bash
7579
docker compose --profile codegen-xeon-vllm up -d
7680
```
7781

78-
3. **Validate:**
82+
4. **Validate:**
7983
Wait several minutes for models to download (especially the first time) and services to initialize. Check container logs (`docker compose logs -f <service_name>`) or proceed to the validation steps below.
8084

8185
## Available Deployment Options

0 commit comments

Comments
 (0)