Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The live mode does not return a response when just prompted with image #156

Open
akashbangad opened this issue Jan 21, 2025 · 1 comment
Assignees
Labels
priority: p2 Moderately-important priority. Fix may not be included in next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@akashbangad
Copy link

akashbangad commented Jan 21, 2025

Environment details
Programming language: Python
OS: Mac OS1 5.1 Beta
Language runtime version: Python 3.13.1
Package version: google-genai 0.5.0

async with self.client.aio.live.connect(model=MODEL, config=CONFIG) as session: await session.send( input={ "data": encoded_data, "mime_type": mime_type }, end_of_turn=True )

When the data is base64 encoded image and mime_type is image/jpeg the model does not return a response unless prompted with text. For example when I have a system_instruction to call a function whenever there is red object detected in the image the and then I start sending the image base64 input the model does not respond but If I prompt with text something like "Do you see the red object" after every base64 image input I do see a response.

@akashbangad akashbangad added priority: p2 Moderately-important priority. Fix may not be included in next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Jan 21, 2025
@sasha-gitg sasha-gitg self-assigned this Jan 21, 2025
@akashbangad
Copy link
Author

Is there an update on this issue? Is it due to the library or is it due to an issue with the gemini service ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: p2 Moderately-important priority. Fix may not be included in next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Development

No branches or pull requests

2 participants