LIGHT-SERNET icon indicating copy to clipboard operation
LIGHT-SERNET copied to clipboard

Test data seen during training - correct results?

Open adrianastan opened this issue 2 years ago • 0 comments

Hi,

I just noticed in your code that you are using the test data from the CV fold as validation data and save the best model based on the validation accuracy. This is sort of cherry picking the model. Do you by any chance have updated results where you do not use the test set during training?

Thanks, Adriana

adrianastan avatar Aug 10 '23 10:08 adrianastan