Skip to content

Commit 983eeb7

Browse files
authored
Add tutorial for deploying DeepSeek-R1-Distill-Llama3.1-8B (#305)
1 parent a1232e3 commit 983eeb7

File tree

2 files changed

+439
-0
lines changed

2 files changed

+439
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
dtype: "half"
2+
max_model_len: 2048
3+
gpu_memory_utilization: 0.96
4+
enable_reasoning: true
5+
reasoning_parser: "deepseek_r1"

0 commit comments

Comments
 (0)