Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explainability support #16

Open
mtanghu opened this issue Sep 3, 2022 · 0 comments
Open

Explainability support #16

mtanghu opened this issue Sep 3, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@mtanghu
Copy link
Owner

mtanghu commented Sep 3, 2022

Some original ideas will likely be needed, but in general this should be achievable simply through measuring the dot-product similarities of F1 and F2 (and also softmaxing them) to see what tokens the model is paying attention to, then factor in the querying aspect.

A good entry point would be to reproduce a variation of the pairwise Attention diagram found in the appendix of Attention is All you Need

@mtanghu mtanghu added enhancement New feature or request help wanted Extra attention is needed labels Sep 3, 2022
@mtanghu mtanghu removed the help wanted Extra attention is needed label Dec 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant