Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How is this Possible? #2675

Closed
5 tasks done
August-murr opened this issue Jan 28, 2025 · 1 comment
Closed
5 tasks done

How is this Possible? #2675

August-murr opened this issue Jan 28, 2025 · 1 comment
Labels
🐛 bug Something isn't working 🏋 GRPO Related to GRPO

Comments

@August-murr
Copy link
Collaborator

August-murr commented Jan 28, 2025 •
edited
Loading

Reproduction

Reproduction in Kaggle:
Notebook

The script is similar to the one provided in the docs.
and it uses tiny qwen

@qgallouedec
How can a model with 2.5 million parameters run out of memory with 30 GB of VRAM?

System Info

Kaggle 2xT4 notebook

Checklist

  • I have checked that my issue isn't already filed (see open issues)
  • I have included my system information
  • Any code provided is minimal, complete, and reproducible (more on MREs)
  • Any code provided is properly formatted in code blocks, (no screenshot, more on code blocks)
  • Any traceback provided is complete
@github-actions github-actions bot added 🏋 GRPO Related to GRPO 🐛 bug Something isn't working labels Jan 28, 2025
@Superskyyy
Copy link
Contributor

See #2669

@August-murr August-murr mentioned this issue Jan 29, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
🐛 bug Something isn't working 🏋 GRPO Related to GRPO
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Superskyyy @August-murr