MetaR-CNN icon indicating copy to clipboard operation
MetaR-CNN copied to clipboard
verified publisher icon yanxp

Results un-reproducible after your revision on Nov 6, 2019

Open Ze-Yang opened this issue 6 years ago • 3 comments

As I report in the previous issue, I notice that you have fixed it. However, this will lead to significant decrease of the performance due to the reduce of annotations, e.g., VOC setup1 5shot, dropping from 43.5% to 36.5%. Could you explain it? Otherwise, I regard that the promising results in your paper maybe just owe to the bug you fixed.

Ze-Yang avatar Nov 18 '19 08:11 Ze-Yang

hello, the following code is our original implementation. We thought they are equivalent. And we re-run the setup1 5shot , we can get the result as 45.1%. Screenshot from 2019-11-19 10-39-48

yanxp avatar Nov 19 '19 02:11 yanxp

Could you reproduce the result with your latest code? I rerun your code for many times, but cannot get the result you indicate. Thanks.

Ze-Yang avatar Nov 19 '19 04:11 Ze-Yang

hello, the following code is our original implementation. We thought they are equivalent. And we re-run the setup1 5shot , we can get the result as 45.1%. Screenshot from 2019-11-19 10-39-48

Thanks for pointing this, may I know the corresponding commit revision please?

deepseawhale avatar Sep 27 '21 04:09 deepseawhale