Skip to content

Commit b22e8bd

Browse files
committed
add typing
1 parent b3c5d05 commit b22e8bd

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1414,7 +1414,7 @@ def get_beam_search_score(
14141414
return cumulative_logprob / (seq_len**length_penalty)
14151415

14161416

1417-
def create_sort_beams_key_function(eos_token_id: int, length_penalty):
1417+
def create_sort_beams_key_function(eos_token_id: int, length_penalty: float):
14181418

14191419
def sort_beams_key(x: BeamSearchSequence) -> float:
14201420
return get_beam_search_score(x.tokens, x.cum_logprob, eos_token_id,

0 commit comments

Comments
 (0)