superbenchmark
superbenchmark copied to clipboard
Analyzer - Make baseline file optional in data diagnosis and fix bugs
Description Make baseline check optional in data diagnosis and fix bugs.
Major Revision
- make baseline file optional in data diagnosis
- fix bugs of output in md and excel format when 'function' is not in the rule
- fix bug in multi_rules function that miss/failed test may failed the whole process
Minor Revision
- revise doc related with data diagnosis
- resolve warning message about baseline not found check, only raise exception if baseline not found in the 'variance' function
- move summary fields into top of json file
- unify 'Index','machine' -> 'index' in output file
Codecov Report
Merging #399 (a5ea59e) into release/0.6 (4c21557) will increase coverage by
0.00%. The diff coverage is90.90%.
@@ Coverage Diff @@
## release/0.6 #399 +/- ##
============================================
Coverage 88.76% 88.77%
============================================
Files 83 83
Lines 5262 5265 +3
============================================
+ Hits 4671 4674 +3
Misses 591 591
| Flag | Coverage Δ | |
|---|---|---|
| cpu-python3.6-unit-test | 75.22% <90.90%> (+0.01%) |
:arrow_up: |
| cpu-python3.7-unit-test | 75.22% <90.90%> (+0.01%) |
:arrow_up: |
| cuda-unit-test | 88.70% <90.90%> (+<0.01%) |
:arrow_up: |
Flags with carried forward coverage won't be shown. Click here to find out more.
| Impacted Files | Coverage Δ | |
|---|---|---|
| superbench/analyzer/diagnosis_rule_op.py | 96.39% <80.00%> (-0.78%) |
:arrow_down: |
| superbench/analyzer/file_handler.py | 89.56% <91.66%> (+0.09%) |
:arrow_up: |
| superbench/analyzer/data_diagnosis.py | 91.85% <100.00%> (+0.29%) |
:arrow_up: |
| superbench/cli/_result_handler.py | 100.00% <100.00%> (ø) |
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.