Arjun Suresh comments

Results 502 comments of


                                            Arjun Suresh

Rename submission-checker.py to submission_checker.py

Sure @tjablin. Nothing urgent.

Rename submission-checker.py to submission_checker.py

@pgmpablo157321 Sure. I'll close this PR and do another one with the updated changes.

[URGENT] RetinaNet mAP is 37.50% on main, 37.55% on r2.1 branch

This is the accuracy we got with the reference implementation (fp32) using onnxruntime backend. Not sure why but mAP is lower than 37.575% ( 37.572% ) ``` Average Precision (AP)...

[URGENT] RetinaNet mAP is 37.50% on main, 37.55% on r2.1 branch

My bad. Sorry I was careless and misread the decimal points. Below are the official figures as in r2.1 branch 1. Pytorch model: 0.3755 2. Onnx model: 0.3757 (0.37572 reproduced...

Fix an unnecessary '.' at beginning of notes if hw_notes is empty

@tjablin @pgmpablo157321 Can you please approve this as this can fix a minor formatting issue on the results table?

TEST04 should have reasonable runtime

Fixed from r2.1

[CK2/CM] Transparently handling variations inside get scripts corresponding to install scripts

I think "PASS_VARIATION_TAGS_TO_POST_DEPS" may not be a good solution as we might have multiple post_deps for a script. Instead we can have `add_to_deps` list inside each variation where the variation,...

[CK2/CM] Converting inputs to env variables for scripts

yes Grigori. By adding in _cm.json we are documenting them also :)

Upstream

Part of another PR. Hence closing

pycocotools for retinanet

Hi @psyhtest , are you referring to [this script](https://github.com/mlcommons/inference/blob/master/vision/classification_and_detection/tools/accuracy-openimages.py)?