LTX-Video icon indicating copy to clipboard operation
LTX-Video copied to clipboard

[Question] Below FP 8 quantization not possible or is not completely worth it ?

Open Greatz08 opened this issue 9 months ago • 1 comments

I wanted to ask this question because i was thinking about if there is any way to run the model under 8GB VRAM :-))

Greatz08 avatar May 10 '25 15:05 Greatz08

GGUFs are available at https://huggingface.co/wsbagnsv1/ltxv-13b-0.9.7-dev-GGUF/tree/main . I've only tried the Q5. Quality is good, but generation times will be looooooong no matter how quantised..

DaveyBoy1970 avatar May 10 '25 17:05 DaveyBoy1970