Skip to content

Go ahead and axolotl questions

License

Notifications You must be signed in to change notification settings

kunato/axolotl

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Fine-tune Typhoon example

Install

conda create -n axolotl python=3.10 -c conda-forge
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cu121
pip install -e .
pip install flash-attn

Run

python scripts/finetune.py examples/typhoon/typhoon-qlora.yml

Credit & Thank you

About

Go ahead and axolotl questions

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.5%
  • Other 0.5%