qwen.cpp icon indicating copy to clipboard operation
qwen.cpp copied to clipboard
verified publisher icon QwenLM

Can you add an additional function to let convert.py support Qwen/Qwen-7B-Chat-Int4?

Open x1ngzai opened this issue 2 years ago • 0 comments

It seems conversion on Qwen-7B-Chat needs more than 32GB memory to run. It probably can be solved by conversion for Int4

x1ngzai avatar Oct 21 '23 11:10 x1ngzai