Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature : Support SPLADE pooling #399

Open
tsensei opened this issue Oct 7, 2024 · 0 comments
Open

Feature : Support SPLADE pooling #399

tsensei opened this issue Oct 7, 2024 · 0 comments

Comments

@tsensei
Copy link

tsensei commented Oct 7, 2024

Feature request

I want to run the https://huggingface.co/prithivida/Splade_PP_en_v1 using infinity. While it loads the model, but the output isn't the sparse representation. It being a sparse embedding model, the huggingface Text Embedding Interface documentation says we need to set the pooling to splade. I am not sure if that solves the issue and will output sparse representation but the idea is to support sparse representation output.

Motivation

Embedding support for hybrid retrieval, infinity already support Dense models, supporting Sparse model would make it more versatile and drop in tool for hybrid retrieval approach

Your contribution

Went through previous issues but found nothing relevant

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant