AutoPoison icon indicating copy to clipboard operation
AutoPoison copied to clipboard

lora fine-tuning

Open lazyeden opened this issue 2 years ago • 0 comments

Is it necessary to fine-tune all parameters during the training process? Why does the loss explode when I use lora fine-tuning Llama 2 7B?

lazyeden avatar Nov 28 '23 02:11 lazyeden