Script about finetuning

[Chrisliu89]

I tried the train-gen script, but it gave an error. After I changed all "module" to "modules", it showed a new error. Could you please check your code again? I really want to run it successfully. I would be very grateful if you could.

[ElectricAlexis]

Hi, I guess that you might use multiple GPUs for fine-tuning.
If you are using multiple GPUs, please have a try on this command: accelerate launch --multi_gpu --mixed_precision fp16 train-gen.py
If you only use one GPU, simply denote the GPU when running the script: CUDA_VISIBLE_DEVICES=0 python train_gen.py
I hope this solves your problem. 😄