research-contributions icon indicating copy to clipboard operation
research-contributions copied to clipboard

Reproduce the Paper Results

Open mmaaz60 opened this issue 3 years ago • 3 comments

Hi Authors,

I wonder if you can provide the detailed instructions (and pretrained models as well ideally) to reproduce the results reported in the paper (0.918 avg. dice score). Thanks

image

mmaaz60 avatar Jun 24 '22 14:06 mmaaz60

Hi @mmaaz60

Thanks for the interest in our work. For the leaderboard benchmarks, an ensemble of 20 models were used. In addition, following previous SOTA on this leaderboard, such as PaNN, we used extra private training data (80 volumes total). We have discussed this in section 4.3 of the UNETR paper (which uses same settings).

Best,

ahatamiz avatar Jun 28 '22 13:06 ahatamiz

Hello @ahatamiz,

Thank you for your amazing work! Your results are super inspiring! I would like to test some my thoughts on neural net architecture modifications, but I wanna be confident in my experiments. Do you have results on test set with no extra data? And is this extra data publicly available? It is pretty difficult to try outperform your SOTA using almost triple time smaller dataset.

Best regards,

maxmanko avatar Oct 05 '22 13:10 maxmanko

Hi, i would also be interested in the additional data or at least the results without additional data. Is there a chance to share this with us? Thank you.

Best

constantinulrich avatar Oct 13 '22 11:10 constantinulrich