We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
$ enroot start --mount ${PWD}:${PWD} \ > --env NVIDIA_VISIBLE_DEVICES=void picotron.sqsh \ > python3 /picotron/create_config.py \ > --out_dir ${PWD}/conf --exp_name llama-1B-tp2 --dp 1 --tp 2 --pp 1 \ > --pp_engine 1f1b --model_name HuggingFaceTB/SmolLM-1.7B --num_hidden_layers 5 \ > --total_train_steps 5000 \ > --grad_acc_steps 2 --mbs 4 --seq_len 128 --hf_token ${HF_TOKEN} [ERROR] Command not found: squashfuse
I had to install it manually.
sudo apt-get install -y squashfuse use-overlayfs
The text was updated successfully, but these errors were encountered:
KeitaW
No branches or pull requests
I had to install it manually.
The text was updated successfully, but these errors were encountered: