kdb icon indicating copy to clipboard operation
kdb copied to clipboard

Using Cityscapes Validation to Test ADVENT

Open tianyu-z opened this issue 5 years ago • 3 comments

I transformed the segmentation map of Cityscapes Validation Datasets (frankfurt, lindau, and munster) into Mask images (by changing the value of the road, sidewalks... to 255 and the rest to 0.) Then, we have 500 pictures in total to evaluate ADVENT.

The JSON files are at /network/tmp1/ccai/data/mask_generation/Cityscapes/structuredData/val and the exact images are at /network/tmp1/ccai/data/Cityscapes/structuredData/val

I used it to validate ADVENT model. The mIOU is between 83.23 and 88.32. Because the "ground truth" is the union of road, sidewalks and anything on the ground rather than "where to flood", the mIOU can only be a reference. If you want to know the detailed performance, please checks the result here: https://www.comet.ml/tianyu-z/advent-ccai/e6eb250447ac4d668c8e2f3225a7fd91?experiment-tab=images

image

tianyu-z avatar May 24 '20 09:05 tianyu-z

I think that's really encouraging! It's able to pick up the main idea (~road + wheels of cars)

vict0rsch avatar May 24 '20 17:05 vict0rsch

(sorry @tianyu-z I had forgotten to press enter!)

vict0rsch avatar May 24 '20 17:05 vict0rsch

Haha, no worries. Thank you for commeting on Sunday!

tianyu-z avatar May 25 '20 00:05 tianyu-z