Skip to content

Commit 980edb8

Browse files
wooyeonlee0sumitd2
authored andcommitted
[Misc] Fix minor typo in scheduler (vllm-project#8765)
Signed-off-by: Sumit Dubey <sumit.dubey2@ibm.com>
1 parent a6c3949 commit 980edb8

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

vllm/core/scheduler.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1554,14 +1554,14 @@ def _get_num_new_tokens(self, seq_group: SequenceGroup,
15541554
# the number of new tokens that is dividable by the block size
15551555
# to avoid partial block matching.
15561556
block_size = self.cache_config.block_size
1557-
reminder = budget.token_budget % block_size
1558-
if reminder != 0:
1557+
remainder = budget.token_budget % block_size
1558+
if remainder != 0:
15591559
raise ValueError("When enabling chunked prefill and "
15601560
"prefix caching, max_num_batched_tokens "
15611561
"(chunk size) must be dividable by "
15621562
"block size, but got chunk_size "
15631563
f"({budget.token_budget}) % block_size "
1564-
f"({block_size}) = {reminder}")
1564+
f"({block_size}) = {remainder}")
15651565
if remaining_token_budget < num_new_tokens:
15661566
num_new_tokens = (remaining_token_budget //
15671567
block_size) * block_size

0 commit comments

Comments
 (0)