ANT_Micro22
ANT_Micro22 copied to clipboard
clevercool
https://github.com/clevercool/ANT_Micro22/blob/main/ant_quantization/antquant/quant_modules.py#L245 if B = 6 with signed bit, value bit is 5, then neg_exp_num is 4, and the i rangs [0, 5), so exp_bit would be 6 when i is...
Hi, I was trying to quantize OPT-13B in 8bits(W/A), but there is an error--'run out of memory(128G)'. So I want to know do you have the same problem? Or do...
Hello, I was wondering if you are able to provide the code used to generate figure 14 in your paper? I was able to mostly replicate the plot for the...
Hi, Are you planning to release the code for llama and mixtral models?
