auto-round icon indicating copy to clipboard operation
auto-round copied to clipboard
verified publisher icon intel

unexpected large ram/vram usage for gguf

Open wenhuach21 opened this issue 4 months ago • 2 comments

https://huggingface.co/Intel/Qwen3-30B-A3B-Instruct-2507-gguf-q2ks-mixed-AutoRound/discussions/4

https://github.com/intel/auto-round/issues/870

wenhuach21 avatar Oct 08 '25 11:10 wenhuach21

https://github.com/intel/auto-round/pull/1043 https://github.com/intel/auto-round/pull/1031

n1ck-guo avatar Nov 25 '25 08:11 n1ck-guo

The ram usage is still high

wenhuach21 avatar Nov 25 '25 08:11 wenhuach21