nncf icon indicating copy to clipboard operation
nncf copied to clipboard

[NNCF] Track and report u8, u4 constants in weight compression tests.

Open YutingGao7 opened this issue 1 year ago • 1 comments

Changes

[NNCF] Track and report u8, u4 constants in weight compression tests.

Reason for changes

This PR is for https://github.com/openvinotoolkit/nncf/issues/2565.

Related tickets

Tests

NUM_VAL_THREADS=8 pytest --data=./imagenet/val --output=./tmp tests/post_training/test_quantize_conformance.py

YutingGao7 avatar Mar 11 '24 18:03 YutingGao7

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.59%. Comparing base (edd397b) to head (45ee2ec). Report is 4 commits behind head on develop.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##           develop    #2571      +/-   ##
===========================================
- Coverage    90.83%   84.59%   -6.24%     
===========================================
  Files          498      498              
  Lines        45621    45574      -47     
===========================================
- Hits         41438    38552    -2886     
- Misses        4183     7022    +2839     

see 58 files with indirect coverage changes

Flag Coverage Δ
COMMON 42.77% <ø> (+0.03%) :arrow_up:
ONNX 34.78% <ø> (+<0.01%) :arrow_up:
OPENVINO ?
TENSORFLOW 29.59% <ø> (+<0.01%) :arrow_up:
TORCH 66.00% <ø> (+<0.01%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
common 93.10% <ø> (-0.66%) :arrow_down:
torch 93.44% <ø> (+<0.01%) :arrow_up:
tensorflow 93.74% <ø> (+0.01%) :arrow_up:
onnx 93.05% <ø> (ø)
openvino 25.58% <ø> (-68.49%) :arrow_down:
ptq 67.31% <ø> (-20.43%) :arrow_down:

codecov[bot] avatar Mar 11 '24 19:03 codecov[bot]

@YutingGao7 Hi, are you still working on this task? Do you need any help? Please inform us if you do not plan to continue working on this task. Thanks!

andrey-churkin avatar Mar 21 '24 16:03 andrey-churkin

Due to the lack of activity @YutingGao7 was unassigned from the issue and PR is closed

ljaljushkin avatar Apr 03 '24 09:04 ljaljushkin