You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hybrid search's current normalization techniques considers scores to bring different sub queries to same scale. Using this approach, the top-ranked result will invariably receive a score of 1, while the lowest-ranked result will consistently be assigned a score of 0, regardless of their proximity or distance from the search query. Integrating the normalized scores with additional sub-queries can potentially introduce bias, as the score distribution may influence the overall results for certain data sets.
What solution would you like?
As an alternative normalization and combination technique, Reciprocal Rank Fusion (RRF) for Hybrid Search utilizes the positions or ranks of the documents rather than relying solely on their scores. This approach aims to mitigate potential biases that may arise from combining scaled scores with other sub-queries.
The text was updated successfully, but these errors were encountered:
vamshin
changed the title
[FEATURE] Add Reciprocal Rank Fusion(RRF) for Hybrid Search as a new normalization/combination technique
[FEATURE] Add Rank based combination technique for Hybrid Search
Apr 1, 2024
Is your feature request related to a problem?
Hybrid search's current normalization techniques considers scores to bring different sub queries to same scale. Using this approach, the top-ranked result will invariably receive a score of 1, while the lowest-ranked result will consistently be assigned a score of 0, regardless of their proximity or distance from the search query. Integrating the normalized scores with additional sub-queries can potentially introduce bias, as the score distribution may influence the overall results for certain data sets.
What solution would you like?
As an alternative normalization and combination technique, Reciprocal Rank Fusion (RRF) for Hybrid Search utilizes the positions or ranks of the documents rather than relying solely on their scores. This approach aims to mitigate potential biases that may arise from combining scaled scores with other sub-queries.
The text was updated successfully, but these errors were encountered: