LLaMA3-Quantization icon indicating copy to clipboard operation
LLaMA3-Quantization copied to clipboard
verified publisher icon Macaronlin

5,6-bit quantizations?

Open roberthoenig opened this issue 1 year ago • 0 comments

Do you plan to release quantizations with 5 and 6 bits?

roberthoenig avatar Apr 27 '24 08:04 roberthoenig