[NNCF] Track and report u8, u4 constants in weight compression tests.
Changes
[NNCF] Track and report u8, u4 constants in weight compression tests.
Reason for changes
This PR is for https://github.com/openvinotoolkit/nncf/issues/2565.
Related tickets
Tests
NUM_VAL_THREADS=8 pytest --data=./imagenet/val --output=./tmp tests/post_training/test_quantize_conformance.py
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 84.59%. Comparing base (
edd397b) to head (45ee2ec). Report is 4 commits behind head on develop.
Additional details and impacted files
@@ Coverage Diff @@
## develop #2571 +/- ##
===========================================
- Coverage 90.83% 84.59% -6.24%
===========================================
Files 498 498
Lines 45621 45574 -47
===========================================
- Hits 41438 38552 -2886
- Misses 4183 7022 +2839
see 58 files with indirect coverage changes
| Flag | Coverage Δ | |
|---|---|---|
| COMMON | 42.77% <ø> (+0.03%) |
:arrow_up: |
| ONNX | 34.78% <ø> (+<0.01%) |
:arrow_up: |
| OPENVINO | ? |
|
| TENSORFLOW | 29.59% <ø> (+<0.01%) |
:arrow_up: |
| TORCH | 66.00% <ø> (+<0.01%) |
:arrow_up: |
Flags with carried forward coverage won't be shown. Click here to find out more.
| Components | Coverage Δ | |
|---|---|---|
| common | 93.10% <ø> (-0.66%) |
:arrow_down: |
| torch | 93.44% <ø> (+<0.01%) |
:arrow_up: |
| tensorflow | 93.74% <ø> (+0.01%) |
:arrow_up: |
| onnx | 93.05% <ø> (ø) |
|
| openvino | 25.58% <ø> (-68.49%) |
:arrow_down: |
| ptq | 67.31% <ø> (-20.43%) |
:arrow_down: |
@YutingGao7 Hi, are you still working on this task? Do you need any help? Please inform us if you do not plan to continue working on this task. Thanks!
Due to the lack of activity @YutingGao7 was unassigned from the issue and PR is closed