Is it possible to continue training from the last lora checkpoint?

[edwardelric1202]

Hi, I wonder that if I can continue finetune this model from the last lora checkpoint if I interrupted training process?

[brainwavecoder9]

With PyTorch trainer you can replace trainer.train()

with trainer.train(resume_from_checkpoint=<PATH>) e.g. "checkpoint-1234" or trainer.train(resume_from_checkpoint = True)

More info from HF docs