You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When trying to connect the program to koboldcpp's API (localhost:5001/v1) it throws an error.
To Reproduce
Install infinite-sides as normal, then launch a .gguf model with koboldcpp and try to connect infinite-sides to the API address of koboldcpp.
Expected behavior
infinite-sides should connect to koboldcpp and display the currently running model in the selection menu.
Screenshots
Desktop (please complete the following information):
OS: Windows
The text was updated successfully, but these errors were encountered:
Currently Infinite sides only support ollama or any other software that supports ollama's API, so you might need to install ollama and models through it, i could add support for others but that might break some parts of the app.
If you want custom models i think ollama has modelfiles you can check that out,
Describe the bug
When trying to connect the program to koboldcpp's API (localhost:5001/v1) it throws an error.
To Reproduce
Install infinite-sides as normal, then launch a .gguf model with koboldcpp and try to connect infinite-sides to the API address of koboldcpp.
Expected behavior
infinite-sides should connect to koboldcpp and display the currently running model in the selection menu.
Screenshots

Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: