[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling#9038

Merged

LiuXiaoxuanPKU merged 6 commits intovllm-project:mainfrom

neuralmagic:varun/fix-num-computed-tokens-v2

Oct 6, 2024

Commits on Oct 3, 2024

fix num computed tokens
Varun Sundar Rabindranath
committed
format
Varun Sundar Rabindranath
committed

Commits on Oct 4, 2024

review comments
Varun Sundar Rabindranath
committed

Commits on Oct 6, 2024

skip tests for any attn other than flash-attn
Varun Sundar Rabindranath
committed
skip rocm
Varun Sundar Rabindranath
committed
fix multi-step + rocm_flash_attn support
Varun Sundar Rabindranath
committed