Skip to content

[Bugfix] Support testing prefill throughput with benchmark_serving.py --hf-output-len 1#8891

Merged
ywang96 merged 2 commits intovllm-project:mainfrom
heheda12345:benchmark_serving_prefill
Sep 28, 2024

Commits

Commits on Sep 27, 2024