Peng Yao issues

Repositories
Issues
Comments

Results 2 issues of


                                            Peng Yao

How to get the mean value of massive activation

1. How to get the mean value of massive activation？e.g. 2546.8/-1502.0 in hook.py 2. Mean value is still large, what is the difference between using the mean value and using...

Maybe a bug in "allow_padding"

https://github.com/ModelTC/llmc/blob/main/llmc/compression/quantization/quant.py Line 629: deficiency = self.group_size - tensor.shape[1] % self.group_size tensor.shape[-1] is ok?