Skip to content

Commit 5201002

Browse files
committed
Revert: TODO's
1 parent 2992769 commit 5201002

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

examples/llama-3/sft.yaml

+2-4
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,4 @@
1-
base_model: "nm-testing/llama2.c-stories42M-gsm8k-sparse-only-uncompressed"
2-
# TODO: change to
3-
# base_model: neuralmagic/Sparse-Llama-3.1-8B-2of4
1+
base_model: neuralmagic/Sparse-Llama-3.1-8B-2of4
42

53
plugins:
64
- axolotl.integrations.llmcompressor_sft.SFTPlugin
@@ -27,7 +25,7 @@ wandb_watch:
2725
wandb_name:
2826
wandb_log_model:
2927

30-
# gradient_accumulation_steps: 8
28+
gradient_accumulation_steps: 8
3129
micro_batch_size: 1
3230
num_epochs: 1
3331
optimizer: paged_adamw_8bit

0 commit comments

Comments
 (0)