chainercv icon indicating copy to clipboard operation
chainercv copied to clipboard

possible bug in the way that mIoU is computed

Open seyeeet opened this issue 4 years ago • 0 comments

I notice that the results for miou does not match with miou that I manually compute. here is an example, lets say pres and labels are two lists including the predictions and gt data I can compute the confusion matrix via chainercv.evaluations.calc_semantic_segmentation_confusion I also can compute the miou via chainercv.evaluations.eval_semantic_segmentation(preds, labels)

the miou based on confusion matrix can be computed as np.nanmean(np.diag(confusion) / (confusion.sum(axis=1) + confusion.sum(axis=0) - np.diag(confusion))) and these results dont match with np.nanmean(chainercv.evaluations.eval_semantic_segmentation(preds, labels)['iou'])

seyeeet avatar May 28 '21 17:05 seyeeet