o3-mini

[ceicke]

Hello!

I wanted to try the o3-mini model and set it up in my HostedGPT instance. However, I get this error:

(I received a unexpected response from the API after retrying 3 times, "{
"error": {
"message": "Unsupported parameter: ''max_tokens'' is not supported with this model. Use ''max_completion_tokens'' instead.",
"type": "invalid_requ". The AI servers may be experiencing trouble. Try again later or if you keep getting this error ensure your API key is valid and you haven''t run out of funds with your AI service.

Did OpenAI introduce a breaking change into their API? Because I guess this error message comes from the ruby-openai gem. Or did I do something wrong?

Cheers,
Christoph

[lumpidu]

O1 previwe is also broken in a similar manner

[krschacht]

Ah, it looks like max_tokens was deprecated and changed to max_completion_tokens awhile ago and these o1/o3 class models are the first ones that have dropped support for the old field name: https://platform.openai.com/docs/api-reference/chat/create

Can you someone simply try changing this:

hostedgpt/app/services/ai_backend/open_ai.rb

Line 69 in b963887

max_tokens: 2000, # we should really set this dynamically, based on the model, to the max

If you someone can locally try renaming that attribute locally and confirm it works with both the old gpt-4o models and the new o3-mini, then we just need a PR. I'm hoping it's just that simple!

[krschacht]

Oh, it just occurred to me that Groq uses this same backend, but it looks like they've followed OpenAI in this so I expect it will just work there too:
https://console.groq.com/docs/api-reference#chat-create

[ceicke]

Yeah, I can confirm that it works. I tested with:

• GPT4-o
• 3o-mini

If you give me push access to the repo I can also provide a PR.

[lumpidu]

You need to fork the repo to your own user and make a PR from within your forked repo on GitHub

[ceicke]

I know. I thought that @krschacht granted some people access already, because I wanted to avoid the whole cycle...

[ceicke]

PR: #614