Skip to content

Commit 42ffba1

Browse files
authored
[Misc] Use RoPE cache for MRoPE (#8396)
1 parent 295c473 commit 42ffba1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -990,7 +990,7 @@ def get_rope(
990990
base, is_neox_style, dtype, short_factor, long_factor,
991991
**extra_kwargs)
992992
elif scaling_type == "mrope":
993-
return MRotaryEmbedding(
993+
rotary_emb = MRotaryEmbedding(
994994
head_size,
995995
rotary_dim,
996996
max_position,

0 commit comments

Comments
 (0)