You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Customer wanted to apply LoRA to a local LLM to create a genre-specific LLM.
To do this, they prepared CSV training data, and through experimentation, an adapter in .safetensors format was generated.
They tried to apply the created .safetensors to Ollama, but it resulted in an error (sorry, I don't have the error message on hand).
It seems that it was able to confirm the creation of the adapter,
But we are unable to apply that adapter to Ollama or LM Studio or other, or to complete and verify its application to the LLM in H2O LLM Studio.
🐛 Bug
Not able to add LoRA to an LLM on H2O-LLM-Studio
To Reproduce
Customer wanted to apply LoRA to a local LLM to create a genre-specific LLM.
To do this, they prepared CSV training data, and through experimentation, an adapter in .safetensors format was generated.
They tried to apply the created .safetensors to Ollama, but it resulted in an error (sorry, I don't have the error message on hand).
It seems that it was able to confirm the creation of the adapter,
But we are unable to apply that adapter to Ollama or LM Studio or other, or to complete and verify its application to the LLM in H2O LLM Studio.
LLM Studio version
"H2O LLM Studio" v1.14.0-dev
20250118_H2o_pug_train_en.zip
The text was updated successfully, but these errors were encountered: