APoT_Quantization icon indicating copy to clipboard operation
APoT_Quantization copied to clipboard

quantization bit of apot

Open knockshot opened this issue 4 years ago • 2 comments

Hello, I have read your papar and your code. I found that in code the Build_power_value matched the describtion in paper. However, the weight_quantization_function passed the (bitwidth-1) value as B in Build_power_value, which means 4-bit quantization levels used 3-bit formula. I wondered whether I missed something in paper or code?

knockshot avatar Sep 20 '21 18:09 knockshot

I have exactly the same problem as Knockshot

Hitlemon avatar Feb 18 '23 11:02 Hitlemon

Because the weight is signed, the weight of the positive value uses 3-bit formula, and the same as negative value. The positive and negative weights and 0 together occupy a total of 4-bit. And the activation value is non-negative, so it uses bitwidth instead of (bitwidth-1).

Minato-Zackie avatar Jul 03 '23 12:07 Minato-Zackie