Skip to content

Commit 3809458

Browse files
authored
[Bugfix] Fix invalid rotary embedding unit test (#13431)
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
1 parent d3231cb commit 3809458

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/kernels/test_rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ def test_rotary_embedding_opcheck(dist_init, device, max_position,
4141
is_neox_style, rotary_dim, head_size,
4242
seq_len):
4343
batch_size = 1
44-
base = 0
44+
base = 10000
4545
num_heads = 7
4646
rot = RotaryEmbedding(head_size, rotary_dim, max_position, base,
4747
is_neox_style, torch.float32)

0 commit comments

Comments
 (0)