Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

metal support #8

Closed
MarcusDunn opened this issue Jan 3, 2024 · 3 comments
Closed

metal support #8

MarcusDunn opened this issue Jan 3, 2024 · 3 comments
Labels
🪄 enhancement additions to the software help wanted 🍎 mac macos only updates 🚀 performance there is something that should be faster

Comments

@MarcusDunn
Copy link
Contributor

Currently we support CUDA as the only accelerator. Metal would be a nice addition and is very well supported by llama.cpp
@MarcusDunn MarcusDunn reopened this Feb 3, 2024
@MarcusDunn MarcusDunn mentioned this issue Feb 3, 2024
Closed
@MarcusDunn
Copy link
Contributor Author

some work done in #65 - not working yet.

@MarcusDunn MarcusDunn added 🍎 mac macos only updates 🪄 enhancement additions to the software 🚀 performance there is something that should be faster help wanted labels Feb 6, 2024
@MarcusDunn
Copy link
Contributor Author

MarcusDunn commented Feb 11, 2024 •
edited
Loading

I am not familiar enough with either cpp or mac to debug this - I think I'm mostly along the right track, but if someone could take this across the finish line that would be great.

Currently getting a error about mach-o :/

This was referenced Feb 21, 2024
Merged
Merged
@MarcusDunn
Copy link
Contributor Author

fixed in #65

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
🪄 enhancement additions to the software help wanted 🍎 mac macos only updates 🚀 performance there is something that should be faster
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@MarcusDunn