dolly
dolly copied to clipboard
How to quantize dolly-v2 models to 4-bit?
Hi, I wonder how to quantize dolly-v2 models to 4-bit.