GPTQModel icon indicating copy to clipboard operation
GPTQModel copied to clipboard

[DOC] All of the Quantization Examples have wrong reference to `backends`.

Open ColumbusAI opened this issue 11 months ago • 1 comments

Scripts referenced in this readme

There are only a couple of scripts:

Image

Compared to the readme:

Image

ColumbusAI avatar Feb 18 '25 18:02 ColumbusAI

This is typo/wrong doc title. Actual Quantization currently is using a fixed backend and any backend you use will not improve or materially change the quantization process. Backend is primarily used for post-quant inference. We will fix this and make it more clean. Thanks for the report.

Qubitium avatar Feb 19 '25 08:02 Qubitium