training_extensions icon indicating copy to clipboard operation
training_extensions copied to clipboard
verified publisher icon openvinotoolkit

Exported model performance is too low for detection task

Open yunchu opened this issue 2 years ago • 0 comments

following TCs were reported as failed due to too low accuracy

  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[True-Custom_Object_Detection_Gen3_SSD]
    • AssertionError: trained_performance[k]=0.5714285714285714, exported_performance[k]=0.44444444444444436
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[True-Object_Detection_YOLOX_L]
    • AssertionError: trained_performance[k]=0.6666666666666665, exported_performance[k]=0.3999999999999999
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[False-Custom_Object_Detection_Gen3_SSD]
    • AssertionError: trained_performance[k]=0.5714285714285714, exported_performance[k]=0.44444444444444436
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[False-Object_Detection_YOLOX_L]
    • AssertionError: trained_performance[k]=0.6666666666666665, exported_performance[k]=0.3999999999999999

yunchu avatar Oct 12 '23 05:10 yunchu