marlin icon indicating copy to clipboard operation
marlin copied to clipboard

comparison with SmoothQuant

Open lxww302 opened this issue 1 year ago • 1 comments

I wonder whether you can compared with SmoothQuant, it is a great quantization method that many people tend to use.

lxww302 avatar Jul 29 '24 17:07 lxww302

I wonder whether you can compared with SmoothQuant, it is a great quantization method that many people tend to use.

smoothquant is a method to quantize models, this repo is the implementation of cuda kernel. You cant compare these two things.

Moran232 avatar Aug 28 '24 17:08 Moran232