Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create an overlaid diverging histogram for extraction #35

Open
suhacker1 opened this issue Oct 1, 2020 · 0 comments
Open

Create an overlaid diverging histogram for extraction #35

suhacker1 opened this issue Oct 1, 2020 · 0 comments
Labels
extraction Related to model extraction attacks metrics visualization Part of the three phase metrics visualization project needs validation Some validation is required to document the solution user-facing Features that will directly impact users

Comments

@suhacker1
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
It is difficult to reason about the difference between a victim and substitute model from a simple label agreement score.

Describe the solution you'd like.
Create an overlaid diverging histogram that showcases the correct and incorrect responses on a single axis.

Describe alternatives you've considered.
If a better solution is available, please comment on this issue.

Detail any additional context.
This was inspired by Figure 3 of Understanding and Visualizing Data Iteration in Machine Learning.

@suhacker1 suhacker1 added extraction Related to model extraction attacks user-facing Features that will directly impact users needs validation Some validation is required to document the solution metrics visualization Part of the three phase metrics visualization project labels Oct 1, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
extraction Related to model extraction attacks metrics visualization Part of the three phase metrics visualization project needs validation Some validation is required to document the solution user-facing Features that will directly impact users
Projects
None yet
Development

No branches or pull requests

1 participant