New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

单机单卡训练显存需求 #31

Open

robinjoe93 opened this issue Feb 14, 2025 · 3 comments

robinjoe93 commented Feb 14, 2025

想请问一下，现在如果用单机单卡训练显存大概需要多少？

Contributor

anine09 commented Feb 15, 2025

这个主要取决于你的设置，如果你使用 Unsloth，按照官方的说法，大致 1.5B 的模型需要 7G

Mrkkew commented Feb 18, 2025

请问这个repo中的Unsloth 跟trl的区别就是支持LORA微调吗？

Contributor

anine09 commented Feb 18, 2025

@Mrkkew 可以这么理解，但是 Unsloth 的开源版本仅支持单卡训练

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment