latest HEAD of accelerate causes 0 loss immediately w FSDP (axolotl-ai-cloud#321)

winglian · web-flow · commit 9f69c4d8c121 · 2023-07-24T11:23:56.000-04:00
diff --git a/requirements.txt b/requirements.txt
@@ -1,7 +1,7 @@
 peft @ git+https://github.com/huggingface/peft.git
 transformers @ git+https://github.com/huggingface/transformers.git
 bitsandbytes>=0.39.0
-accelerate @ git+https://github.com/huggingface/accelerate
+accelerate==0.21.0
 addict
 fire
 PyYAML==6.0
