Skip to content

Commit 009b3d5

Browse files
reidliu41reidliu41
and
reidliu41
authored
[Misc] not show --model in vllm serve --help (#16691)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
1 parent e4b8713 commit 009b3d5

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/engine/arg_utils.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@
55
import dataclasses
66
import json
77
import re
8+
import sys
89
import threading
910
import warnings
1011
from dataclasses import MISSING, dataclass, fields, is_dataclass
@@ -440,7 +441,8 @@ def add_cli_args(parser: FlexibleArgumentParser) -> FlexibleArgumentParser:
440441
title="ModelConfig",
441442
description=ModelConfig.__doc__,
442443
)
443-
model_group.add_argument("--model", **model_kwargs["model"])
444+
if 'serve' not in sys.argv[1:] and '--help' not in sys.argv[1:]:
445+
model_group.add_argument("--model", **model_kwargs["model"])
444446
model_group.add_argument("--task", **model_kwargs["task"])
445447
model_group.add_argument("--tokenizer", **model_kwargs["tokenizer"])
446448
model_group.add_argument("--tokenizer-mode",

0 commit comments

Comments
 (0)