Rodrigo Soares Tadewald
Results
3
comments of
Rodrigo Soares Tadewald
Same issue here...
Hello, @AllentDan, thanks for your answer. Unfortunately none of the proposed solutions worked for me. This getting the Assertion Error here: File "/home/rtadewald/miniconda3/envs/lmdeploy/lib/python3.10/site-packages/lmdeploy/lite/quantization/awq.py", line 118, in smooth_ln_fcs assert torch.isnan(p).sum() ==...
Is the project abandoned?