Better support for OpenRouter with Gemini

[lukyanov]

I'm trying to use Instructor with OpenRouter. It works perfectly for OpenAI models, but I can't make it work for Gemini.
Maybe it actually works, but I couldn't figure out how to call Instructor in this case. The tricky part is that I need to use OpenAI client but with Gemini-specific modes.

The following does not work:

        client = instructor.from_openai(OpenAI(base_url="https://openrouter.ai/api/v1"), mode=instructor.Mode.TOOLS)
        response = ai_client.chat.completions.create(
            model="google/gemini-flash-1.5-8b",
            response_model=MyModel
            temperature=0.0,
            max_tokens=4096,
            messages=messages
        )

Changing the mode to instructor.Mode.GEMINI_TOOLS is not helping (failing because GEMINI_TOOLS is not OpenAI mode).

Am I right that my use case is currently not supported?

[ivanleomk]

Hey @lukyanov could you provide some of the error messages that you're encountering with this?

Specifically, what Gemini modes are you using in this case