Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Not able to add LoRA to an LLM on H2O-LLM-Studio #894

Open
PranavM2412 opened this issue Jan 20, 2025 · 0 comments
Open

[BUG] Not able to add LoRA to an LLM on H2O-LLM-Studio #894

PranavM2412 opened this issue Jan 20, 2025 · 0 comments
Labels
type/bug Bug in code

Comments

@PranavM2412
Copy link

🐛 Bug

Not able to add LoRA to an LLM on H2O-LLM-Studio

To Reproduce

Customer wanted to apply LoRA to a local LLM to create a genre-specific LLM.
To do this, they prepared CSV training data, and through experimentation, an adapter in .safetensors format was generated.
They tried to apply the created .safetensors to Ollama, but it resulted in an error (sorry, I don't have the error message on hand).

It seems that it was able to confirm the creation of the adapter,

But we are unable to apply that adapter to Ollama or LM Studio or other, or to complete and verify its application to the LLM in H2O LLM Studio.

LLM Studio version

"H2O LLM Studio" v1.14.0-dev

20250118_H2o_pug_train_en.zip

@PranavM2412 PranavM2412 added the type/bug Bug in code label Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Bug in code
Projects
None yet
Development

No branches or pull requests

1 participant