Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LLM Quantize only supports Ubuntu #109

Closed
arjbingly opened this issue Apr 29, 2024 · 1 comment · Fixed by #120
Closed

LLM Quantize only supports Ubuntu #109

arjbingly opened this issue Apr 29, 2024 · 1 comment · Fixed by #120

Comments

@arjbingly
Copy link
Owner

Currently, the LLM Quantize only supports Ubuntu. Moreover, the script git clones and then builds llama.cpp. Instead, we should be downloading stable builds for the user's OS.
@sanchitvj
Copy link
Collaborator

sanchitvj commented May 1, 2024 •
edited
Loading

This PR solves this issue #118. Now quantization uses stable latest releases for building binaries according to your OS and architecture. Supports Mac, Windows, and Ubuntu [(check here)].(https://github.com/ggerganov/llama.cpp/releases/tag/b2774)

@arjbingly arjbingly linked a pull request May 9, 2024 that will close this issue
Quantization updated to support more OS and architectures #120
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Quantization updated to support more OS and architectures arjbingly/grag
2 participants
@arjbingly @sanchitvj