Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create ONNX version of snowflake-arctic-embed-l #2681

Open
lintool opened this issue Jan 16, 2025 · 3 comments
Open

Create ONNX version of snowflake-arctic-embed-l #2681

lintool opened this issue Jan 16, 2025 · 3 comments

Comments

@lintool
Copy link
Member

lintool commented Jan 16, 2025

Take snowflake-arctic-embed-l from HuggingFace and create an ONNX version thereof.

First, start here: https://github.com/castorini/anserini/blob/master/docs/onnx-conversion.md

Try and reproduced that ONNX conversion - If you've done it right, then you should be able to reproduce this with your newly created model:
https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-msmarco-v1-passage.splade-pp-ed.onnx.md

Then, follow the same procedure to convert snowflake-arctic-embed-l.

@lintool
Copy link
Member Author

lintool commented Jan 19, 2025

Initial work on #2686 - already merged.

@lintool
Copy link
Member Author

lintool commented Jan 24, 2025

@b8zhong next steps here? we actually need to convert the snowflake model to onnx, add bindings, etc.?

@b8zhong
Copy link
Contributor

b8zhong commented Jan 25, 2025

Did conversion; doing java bindings now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants