superbenchmark icon indicating copy to clipboard operation
superbenchmark copied to clipboard

Analyzer - Make baseline file optional in data diagnosis and fix bugs

Open yukirora opened this issue 3 years ago • 1 comments

Description Make baseline check optional in data diagnosis and fix bugs.

Major Revision

  • make baseline file optional in data diagnosis
  • fix bugs of output in md and excel format when 'function' is not in the rule
  • fix bug in multi_rules function that miss/failed test may failed the whole process

Minor Revision

  • revise doc related with data diagnosis
  • resolve warning message about baseline not found check, only raise exception if baseline not found in the 'variance' function
  • move summary fields into top of json file
  • unify 'Index','machine' -> 'index' in output file

yukirora avatar Aug 28 '22 04:08 yukirora

Codecov Report

Merging #399 (a5ea59e) into release/0.6 (4c21557) will increase coverage by 0.00%. The diff coverage is 90.90%.

@@             Coverage Diff              @@
##           release/0.6     #399   +/-   ##
============================================
  Coverage        88.76%   88.77%           
============================================
  Files               83       83           
  Lines             5262     5265    +3     
============================================
+ Hits              4671     4674    +3     
  Misses             591      591           
Flag Coverage Δ
cpu-python3.6-unit-test 75.22% <90.90%> (+0.01%) :arrow_up:
cpu-python3.7-unit-test 75.22% <90.90%> (+0.01%) :arrow_up:
cuda-unit-test 88.70% <90.90%> (+<0.01%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
superbench/analyzer/diagnosis_rule_op.py 96.39% <80.00%> (-0.78%) :arrow_down:
superbench/analyzer/file_handler.py 89.56% <91.66%> (+0.09%) :arrow_up:
superbench/analyzer/data_diagnosis.py 91.85% <100.00%> (+0.29%) :arrow_up:
superbench/cli/_result_handler.py 100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

codecov[bot] avatar Aug 28 '22 04:08 codecov[bot]