Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

not able to reproduce paper results #1

Open
wangemm opened this issue Mar 4, 2020 · 6 comments
Open

not able to reproduce paper results #1

wangemm opened this issue Mar 4, 2020 · 6 comments

Comments

@wangemm
Copy link

wangemm commented Mar 4, 2020

I have been running the code with the default params on MNIST, and using enc_zc_logits as the clustering results.
And get the results:
acc 0.56843
nmi 0.50773
ari 0.35441
fmi 0.44946

@zhampel
Copy link
Owner

zhampel commented Mar 16, 2020

@wangemm There are a number of parameters that can influence results. For example, the initialization of weights (line 51-71 in utils.py), and the width of the latent space distribution (line 81 in utils.py). The original author suggested for the latter a small value of like 0.15 for this, but I chose 0.75 during testing cause it avoided mode collapse on my system.

Furthermore, I did not include a classification model as in the author's original paper and repo. I assume you're using the architectures described in the paper...

@zhampel zhampel assigned zhampel and unassigned zhampel Mar 16, 2020
@wangemm
Copy link
Author

wangemm commented Mar 24, 2020

@zhampel Thanks! I`ll try.

@TanmDL
Copy link

TanmDL commented Mar 31, 2020

@wangemm have you achieved the paper results?

@wangemm
Copy link
Author

wangemm commented Apr 2, 2020

@TanmDL No,I can`t achieve the paper results.

@YuxiaoWang-AI
Copy link

code example 2 error,Please ask about the possible reasons

@PFC-star
Copy link

The paper proposes a modified backpropagation algorithm, but why is it not reflected in the code?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants