Wrong LLMs in backend

[mmarti-tsch]

It seems that upon creation of a chatbot with create-tsi, we dont' always have the LLM in the backend which was selected in the creation process.
Asking the LLM, it reveals that it is using chatGPT 3.5, even though we selected mixtral.

[andrej-schreiner]

@marcusschiesser any idea?

[marcusschiesser]

@mmarti-tsch what's the MODEL value in the .env file? If that's correct my guess is it's the LLM API

[Phalanx-SoftDev]

I experienced the same problem

Even though I selected mistral as llm it shows me GPT-3

[mohdamir]

While it tells its name as GPT3.5, its still Mixtral because in .env file Mixtral is selected and LLM Hub is using that model only. We need to check this hallucination. When i have asked about the creator of the model, following was the response.

[andrej-schreiner]

@tattrongvu is this expected behaviour or do we need to tweak the system prompts?