mikeFore4

When finetuning with LORA, the following error is produced: `RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn` This is mentioned in this [issue](https://github.com/microsoft/DeepSpeed/issues/3339)...

In forget.py script, the cfg.save_dir directory is created (line 57) then later, the script checks whether the directory exists and exits if it does (line 72). Because the directory is...