quantization bit of apot
Hello, I have read your papar and your code. I found that in code the Build_power_value matched the describtion in paper. However, the weight_quantization_function passed the (bitwidth-1) value as B in Build_power_value, which means 4-bit quantization levels used 3-bit formula. I wondered whether I missed something in paper or code?
I have exactly the same problem as Knockshot
Because the weight is signed, the weight of the positive value uses 3-bit formula, and the same as negative value. The positive and negative weights and 0 together occupy a total of 4-bit. And the activation value is non-negative, so it uses bitwidth instead of (bitwidth-1).