Arpandeep Khatua

Could you please let me know what dataset size this is, what model you're using and what the acc numbers are? As for your question the splits are random but...

I will look into it soon and confirm why this is happening and what we were doing differently. Please elt me know if you see this happening with IGB-small and...

Until I get a chance to look into it (don't have the setup with me rn), feel free to shuffle the dataset and continue your experiments.

Hello Yichuan I ran this model using the default setup and I wasn't being able to reproduce those numbers. I also looked in the distribution of labels in the train/val/test...

Updated previous comment. Closing this issue for now. Will set a backlog to explore this. You could potentially plot out your train/test/val label districution to confirm if it matches the...

Ahh, I see the code in the repo only shows the train acc of the last batch. Maybe try using this in the train loop? (notice the train_acc is a...

[train_single_gpu.py.zip](https://github.com/IllinoisGraphBenchmark/IGB-Datasets/files/12778292/train_single_gpu.py.zip) Here is the file I'm using. Feel free to use this script. Unfortunately given that the label distribution is similar in the splits, I cannot think of a reason...

Hey Yichuan, I pulled the code from the repo and ran it and I am able to reproduce your results. Seems like there is indeed a ~10% difference in the...

> Yes, this is indeed an intriguing phenomenon. But another point is that if you modify the 'val_dataloader' as: > > val_dataloader = dgl.dataloading.DataLoader( g, train_nid, sampler, batch_size=args.batch_size, shuffle=False, drop_last=False,...

That had some issue with my local dataloader.