Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tensor shape #26

Open
4pygmalion opened this issue Feb 5, 2021 · 0 comments
Open

Tensor shape #26

4pygmalion opened this issue Feb 5, 2021 · 0 comments

Comments

@4pygmalion
Copy link

Thank you for your interest in this issue.

I tried to re-engineer pytorch_influence into TensorFlow 2.0 code.

I wonder how is the tensor shape of return from grad_z() ?

I think the return value is list and includes tensors which are (feature, batch), is it right?

This is because the return value from grad z should be inversed hessian (shape:n_feature x n_feature) when deep learning return as follows F : R ^{feature} -> R^{1}
(hessian is symmatric matrix)

Considering "upweighting Influence function (loss) = grad_z(z_test, theta) ^ {T} * hessian * grad_z(z, theta) ",
the matrix shape must be as follow: (batch. feature) * (feature, feature) * (feature, 1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant