AutoAWQ
AutoAWQ copied to clipboard
Question about format difference between AutoAWQ and AutoGPTQ
Hi @casper-hansen,
For general GEMM quant type, I observe that the qweight shape of AutoAWQ and AutoGPTQ is different due to different pack dimension. I'm confused about why we introduce this difference which causes inconvenience.
Looking forward to your reply, Thanks!