Rodrigo Soares Tadewald

Results 3 comments of Rodrigo Soares Tadewald

Hello, @AllentDan, thanks for your answer. Unfortunately none of the proposed solutions worked for me. This getting the Assertion Error here: File "/home/rtadewald/miniconda3/envs/lmdeploy/lib/python3.10/site-packages/lmdeploy/lite/quantization/awq.py", line 118, in smooth_ln_fcs assert torch.isnan(p).sum() ==...