LLaMA3-Quantization icon indicating copy to clipboard operation
LLaMA3-Quantization copied to clipboard
verified publisher icon Macaronlin

Release Plans for LLaMA3-70B-8bit (smoothquant)

Open chenguanqi opened this issue 1 year ago • 0 comments

Very useful repo!

Are there any plans to release the LLaMA3-70B-8bit (smoothquant), which maintains the same average performance as the original LLaMA3-70B?

chenguanqi avatar Jun 12 '24 06:06 chenguanqi