CodeT5 icon indicating copy to clipboard operation
CodeT5 copied to clipboard
verified publisher icon salesforce

4bit or 8bit quantization?

Open PL2584718785 opened this issue 2 years ago • 0 comments

《Salesforce/instructcodet5p-16b》 Are there any plans of releasing 4bit versions support for this? Thanks.

PL2584718785 avatar Jun 11 '23 06:06 PL2584718785