Skip to content

Commit d2ead05

Browse files
authored
Re-enable Speculative Decode test for vLLM v0.8.5 (#749)
### What this PR does / why we need it? Re-enable Speculative Decode test for vLLM v0.8.5 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? CI passed Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
1 parent 8b194ad commit d2ead05

File tree

1 file changed

+14
-3
lines changed

1 file changed

+14
-3
lines changed

.github/workflows/vllm_ascend_test.yaml

Lines changed: 14 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -136,12 +136,23 @@ jobs:
136136
id: filter_spec_decode
137137
uses: dorny/paths-filter@v3
138138
with:
139-
# speculative decode seems will cause oom issue, disable it now on ci test
140139
filters: |
141-
speculative_tests_changed: 'false'
140+
speculative_tests_changed:
141+
- ".github/workflows/vllm_ascend_test.yaml"
142+
- "tests/singlecard/spec_decode/**"
143+
- "tests/multicard/spec_decode_e2e/**"
144+
- "vllm_ascend/worker/worker.py"
145+
- "vllm_ascend/worker/model_runner.py"
146+
- "vllm_ascend/worker/multi_step_runner.py"
147+
- "vllm_ascend/worker/multi_step_worker.py"
148+
- "vllm_ascend/worker/draft_model_runner.py"
149+
- "vllm_ascend/patch/worker/patch_common/patch_metrics.py"
150+
- "vllm_ascend/patch/worker/patch_common/patch_spec_decode_worker.py"
151+
- "vllm_ascend/patch/worker/patch_common/patch_multi_step_worker.py"
142152
143153
- name: Run vllm-project/vllm-ascend Speculative Decode test
144-
if: steps.filter_spec_decode.outputs.speculative_tests_changed == 'true' || github.event_name == 'schedule'
154+
# speculative decode seems will cause oom issue, only disable it now on ci test with vLLM main
155+
if: matrix.vllm_verison == 'v0.8.5' && steps.filter_spec_decode.outputs.speculative_tests_changed == 'true' || github.event_name == 'schedule'
145156
run: |
146157
if [[ "${{ matrix.os }}" == "linux-arm64-npu-1" ]]; then
147158
pytest -sv tests/singlecard/spec_decode/e2e/test_mtp_correctness.py # it needs a clean process

0 commit comments

Comments
 (0)