Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for gemma2-2b-it(gemma 2nd version) Model Export in Optimum for OpenVINO #2006

Open
chakka12345677 opened this issue Sep 3, 2024 · 1 comment
Labels
onnx Related to the ONNX export

Comments

@chakka12345677
Copy link

Feature request

please provide Support for gemma2 Model Export in Optimum for OpenVINO
version:optimum(1.21.4)
transformers:4.43.4

Motivation

I encountered an issue while trying to export a gemma2 model using the optimum library for ONNX export. The error message suggests that the gemma2 model is either a custom or unsupported architecture, and I need to provide a custom export configuration.

error:raise ValueError(
ValueError: Trying to export a gemma2 model, that is a custom or unsupported architecture, but no custom export configuration was passed as custom_export_configs. Please refer to https://huggingface.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-models for an example on how to export custom models. Please open an issue at https://github.com/huggingface/optimum-intel/issues if you would like the model type gemma2 to be supported natively in the OpenVINO export

Your contribution

It would be great if support for the gemma2 model could be added natively in the optimum library for OpenVINO export. Alternatively, detailed guidance on how to create a custom export configuration for this model would be appreciated.i

@chakka12345677 chakka12345677 changed the title Support for gemma2 Model Export in Optimum for OpenVINO Support for gemma2-2b-it(gemma 2nd version) Model Export in Optimum for OpenVINO Sep 3, 2024
@yonkel
Copy link

yonkel commented Oct 8, 2024

+1, adding ONNX support for gemma-2 models would be appreciated

@tengomucho tengomucho added the onnx Related to the ONNX export label Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
onnx Related to the ONNX export
Projects
None yet
Development

No branches or pull requests

4 participants
@tengomucho @yonkel @chakka12345677 and others