Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Diff between retrieved documents #40

Open
Muennighoff opened this issue Aug 15, 2024 · 0 comments
Open

Diff between retrieved documents #40

Muennighoff opened this issue Aug 15, 2024 · 0 comments

Comments

@Muennighoff
Copy link
Contributor

Cool idea from @KarelDO

A feature to produce a GPT-generated diff of the retrieved documents rather to save voters time.
Though this adds some additional bias. Rather than that, maybe we should just start looking into adding some GPT/Claude votes soon, check if they correlate with human votes, and if so use them to supercharge the leaderboard with more votes. In case someone has bandwidth, lmk!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant