Ving

use autoawq quantizing Qwen2-72B-Instruct error

3

File "/home/qx/.local/lib/python3.10/site-packages/awq/models/base.py", line 231, in quantize self.quantizer.quantize() File "/home/qx/.local/lib/python3.10/site-packages/awq/quantize/quantizer.py", line 166, in quantize scales_list = [ File "/home/qx/.local/lib/python3.10/site-packages/awq/quantize/quantizer.py", line 167, in self._search_best_scale(self.modules[i], **layer) File "/home/qx/.local/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return...