Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compare Numeric with HF Model #2048

Open
omkar-334 opened this issue Jan 17, 2025 · 2 comments
Open

Compare Numeric with HF Model #2048

omkar-334 opened this issue Jan 17, 2025 · 2 comments
Assignees

Comments

@omkar-334
Copy link

omkar-334 commented Jan 17, 2025

Hi,
I wanted to find issues/todo's to contribute to Keras, so I searched for TODO in the codebase.
I found this specific todo appearing about 10 times - mostly in this directory keras_hub\src\utils\transformers .

TODO: compare numerics with huggingface model
What does this mean? Comparing the generated tokens/logits?
Thank you

@omkar-334
Copy link
Author

@divyashreepathihalli
Copy link
Collaborator

divyashreepathihalli commented Jan 23, 2025

hi @omkar-334 we are missing built in transformers/timm, built in converters for the following models- please go ahead and add them if you are interested.
bart
bloom
clip
csp darknet
debertav3
f_net
falcon
llama (2)
mit
mobilenet
opt
phi3
roberta
vgg (missing tests only)
xlm-roberta

Converters are here:
https://github.com/keras-team/keras-hub/tree/master/keras_hub/src/utils/timm
And here:
https://github.com/keras-team/keras-hub/tree/master/keras_hub/src/utils/transformers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants