New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] Time for pretrain and finetune #2

Open

BaleMa opened this issue Dec 17, 2024 · 1 comment

BaleMa commented Dec 17, 2024

Question

How long does it take for you to pre-train and fine-tune the 7B LLaVA model on 8×910B?

zkyntu commented Dec 23, 2024

@BaleMa Hi, I use about 1 hour for stage 1 and 7 hours for stage 2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment