AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

Question about format difference between AutoAWQ and AutoGPTQ

Open xin3he opened this issue 1 year ago • 0 comments

Hi @casper-hansen, For general GEMM quant type, I observe that the qweight shape of AutoAWQ and AutoGPTQ is different due to different pack dimension. I'm confused about why we introduce this difference which causes inconvenience. Looking forward to your reply, Thanks!

xin3he avatar May 08 '24 02:05 xin3he