diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

[docs] quant_kwargs

Open stevhliu opened this issue 8 months ago • 3 comments

Improves where you can find the quant_kwargs in the PipelineQuantizationConfig docs

stevhliu avatar Jun 14 '25 00:06 stevhliu

I think it's probably best to refer the user to the specific API docs for each backend where they can find all the relevant arguments, and keep this one more high-level.

Not sure why the doc-builder is failing though. bitsandbytes should already be installed in the CI test environment no? 🤔

stevhliu avatar Jun 16 '25 19:06 stevhliu

I think it's probably best to refer the user to the specific API docs for each backend where they can find all the relevant arguments, and keep this one more high-level.

Yeah indeed. I was asking for an explicit note that says just that.

sayakpaul avatar Jun 17 '25 03:06 sayakpaul

Not sure why the doc-builder is failing though. bitsandbytes should already be installed in the CI test environment no? 🤔

No actually. bitsandbytes is not a required dependency in our CI and we install it only when running the quantization tests.

I opened https://github.com/huggingface/diffusers/pull/11728 for this. Let's see.

sayakpaul avatar Jun 17 '25 03:06 sayakpaul

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.