New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

App Crashes When I Try To Load Orenguteng/Llama-3.1-8B with 8GB of RAM #3488

Open

nightblade9 opened this issue Feb 12, 2025 · 0 comments

Labels

bug-unconfirmed chat

nightblade9 commented Feb 12, 2025

Pretty much the same story as #3249:

Try to load the Llama-3.1-8B model on a machine
It crashes as soon as you pick it
Try to load 3.1-3B model
It works!

Model specs:

16GB RAM
Vulkan back-end
NVIDIA GTX 1650 Ti GPU

nightblade9 added bug-unconfirmed chat labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment