kast424

AttributeError: 'NoneType' object has no attribute 'to'

7

I am trying to prune with python main.py \ --model mistralai/Mistral-7B-Instruct-v0.2 \ --prune_method wanda \ --sparsity_ratio 0.5 \ --sparsity_type unstructured \ --save out/mistral_7b/unstructured/wanda/ and the output is as below. torch...