dMaSIF icon indicating copy to clipboard operation
dMaSIF copied to clipboard

Problems regarding loss function and auroc

Open WHan-alter opened this issue 3 years ago • 0 comments

Dear Authors,

Thank you for sharing the work and code! I have some problems regarding the AUC-ROC and loss function part. In

https://github.com/FreyrS/dMaSIF/blob/0dcc26c3c218a39d5fe26beb2e788b95fb028896/data_iteration.py#L202-L215

You seemed to sample a random number of positive and negative samples to compute the loss and AUC-ROC. For loss, this could be fine, but regarding the AUC-ROC, did you use the same pipeline for the test dataset when measuring the model performance? If so, what's the performance given the entire surface?

Best, Wenkai

WHan-alter avatar Nov 27 '22 12:11 WHan-alter