MetricsReloaded icon indicating copy to clipboard operation
MetricsReloaded copied to clipboard

Assignment strategy (FP2.5.8) - double assignment, one prediction for multiple references.. also covered?

Open Joeycho opened this issue 1 year ago • 0 comments

Dear Metric Reloaded Team,

I have worked with Brain metastases data, and I was confused when I evaluated lesion-wise (instance-level) detection metrics (F1 -score) from predicted segmentation. Currently, I match each lesion if there is overlap, or overlap(DSC) > 0.1. And I observed that there are quite multiple assigned cases in both ways (one pred - multiple GTs, multiple pred - one GT). That's how I visit your great work (Metric Reloaded) to get some guidance.

I have briefly checked resolve ambiguity code, but I'm still not sure whether this code also treat the remained GTs as FN or ignore them. Or counting TPs is always based on GTs?

I illustrated this issue with the image in the below repository as well, since I used their code.

https://github.com/rachitsaluja/BraTS-2023-Metrics/issues/11

Joeycho avatar Jul 22 '24 12:07 Joeycho