We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
pip install -r benchmarks/requirements-bench.txt
出现问题的代码
bash benchmarks/scripts/run-performance-benchmarks.sh
Running test case serving_qwen2_5_7B_tp1 with qps inf Client command: python3 vllm_benchmarks/benchmark_serving.py --save-result --result-dir results --result-filename serving_qwen2_5_7B_tp1_qps_inf.json --request-rate inf --model Qwen/Qwen2.5-7B-Instruct --backend vllm --dataset-name sharegpt --dataset-path ./ShareGPT_V3_unfiltered_cleaned_split.json --num-prompts 200 python3: can't open file '/home/xhs/tools/vllm-ascend/benchmarks/vllm_benchmarks/benchmark_serving.py': [Errno 2] No such file or directory
仓库里没有benchmark_serving.py
The text was updated successfully, but these errors were encountered:
无法上传报错截图
Sorry, something went wrong.
@Schweizliu Can you show the version of vllm-ascend?
/home/xhs/tools/vllm-ascend/benchmarks/vllm_benchmarks/benchmark_serving.py the path is wrong.
/home/xhs/tools/vllm-ascend/benchmarks/vllm_benchmarks/benchmark_serving.py
No branches or pull requests
Your current environment
🐛 Describe the bug
出现问题的代码
仓库里没有benchmark_serving.py
The text was updated successfully, but these errors were encountered: