pba icon indicating copy to clipboard operation
pba copied to clipboard

Can't reproduce the results in the table3

Open sherylwang opened this issue 6 years ago • 2 comments

Hi, thanks for providing the nice code. I've tried to reproduce the results in table3 with "bash scripts/table_3_rcifar10.sh wrn_28_10". The highest test acc is 87.42% among twice trial, which is much lower than the result in the paper. My tensorflow version is 1.14, ray0.7, cuda10.0, cudnn7. What would be the reason for the low performance?

sherylwang avatar Jan 08 '20 09:01 sherylwang

Sorry, that scrupt actually reflects the main results in table 2, not the ablation in table 3. I will rename the scripts which were named according to an old version of the paper.

In table 2, a result of 87.42% acc or 12.52% error is better than the reported 12.82% error for rcifar10 and wrn28.

arcelien avatar Jan 08 '20 16:01 arcelien

Thanks for your prompt reply. I've checked the reproduced result with the reported result in table2, it indeed matched the performance. @arcelien

sherylwang avatar Jan 09 '20 03:01 sherylwang