Docker images to run on CPU or GPU #251
Replies: 1 comment 5 replies
-
|
That's cool! Very nice. |
Beta Was this translation helpful? Give feedback.
-
|
Updated to 1.32 :) https://hub.docker.com/r/noneabove1182/koboldcpp-gpu |
Beta Was this translation helpful? Give feedback.
-
|
Plans on updating it? Newer versions include OpenAI-compatible endpoints which is nice. |
Beta Was this translation helpful? Give feedback.
-
|
Ah sure! kinda let this one flounder a bit, i'll update it more regularly :) |
Beta Was this translation helpful? Give feedback.
-
|
@entmike updated :) https://hub.docker.com/r/noneabove1182/koboldcpp-gpu/tags and future ones will be faster too! |
Beta Was this translation helpful? Give feedback.
-
|
I linked it on the main repo page too |
Beta Was this translation helpful? Give feedback.
-
I've made up some docker images for KoboldCPP, one for just CPU and one for both CPU and GPU (CPU only image is significantly smaller for anyone who isn't using a GPU)
Has been updated to 1.32.1
https://hub.docker.com/r/noneabove1182/koboldcpp-gpu
https://hub.docker.com/r/noneabove1182/koboldcpp
Beta Was this translation helpful? Give feedback.
All reactions