training_extensions icon indicating copy to clipboard operation
training_extensions copied to clipboard
verified publisher icon openvinotoolkit

Anomaly task training performance degradation for v2.0.0

Open yunchu opened this issue 1 year ago • 1 comments

Anomaly tasks in OTX2.0.0 show performance degradation compared to OTX1.5.2.

How to run the anomaly benchmark tests

pytest -vs tests/perf/test_anomaly.py --output-root benchmark_result --model-category all --data-root /path/to/val-data/v1 --eval-upto train --num-repeat 5

image-2024-04-09-16-28-24-336

yunchu avatar Jun 10 '24 01:06 yunchu

@ashwinvaidya17 - Please check about e2e time degradation.

chuneuny-emily avatar Jun 14 '24 02:06 chuneuny-emily