lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard
Published 2 months ago • verified publisher icon InternLM

How to quantize Qwen2.5-VL 7B?(After Lora)

Open gameboy777x opened this issue 4 months ago • 0 comments

Hi, everyone. I'd like to ask about model quantization. I fine-tuned Qwen2.5-VL 7B on LoRa for visual localization and now want to quantize it. What support does the project provide?

gameboy777x avatar Sep 16 '25 07:09 gameboy777x