Skip to content

Commit 433c160

Browse files
Update run-lm-eval-gsm-vllm-baseline.sh
1 parent b19c862 commit 433c160

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

.buildkite/lm-eval-harness/run-lm-eval-gsm-vllm-baseline.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,5 +47,5 @@ done
4747

4848
lm_eval --model vllm \
4949
--model_args pretrained=$MODEL,tensor_parallel_size=$TP_SIZE,add_bos_token=true,distributed_executor_backend="ray",trust_remote_code=true,max_model_len=4096 \
50-
--tasks ifeval --num_fewshot $FEWSHOT --limit $LIMIT \
50+
--tasks gsm8k --num_fewshot $FEWSHOT --limit $LIMIT \
5151
--batch_size $BATCH_SIZE

0 commit comments

Comments
 (0)