Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproducibility on Airport (node classification) #42

Open
andyweizhao opened this issue Aug 6, 2022 · 1 comment
Open

Reproducibility on Airport (node classification) #42

andyweizhao opened this issue Aug 6, 2022 · 1 comment

Comments

@andyweizhao
Copy link

Hi, I am running HGCN on Airport (with the command below) in the node classification task. Sadly, I received ~77.86 accuracy on test set, far below ~90.6 reported in the paper.

"python train.py --task nc --dataset airport --model HGCN --lr 0.01 --dim 16 --num-layers 2 --act relu --bias 1 --dropout 0.0 --weight-decay 0 --manifold PoincareBall --log-freq 5 --cuda 0 --c None" -- adapted from the Airport command in README provided for link prediction.

I believe I made mistakes. Any hints are very appreciated!

@robertjankowski
Copy link

robertjankowski commented Jun 6, 2023

This is quite a late comment. I also ran HGCN on Airport, and the accuracy I got was 78.05, which is far below the reported one.

Should we use different hyperparameters for this dataset? Or pretrained it like Cora?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants