Retrieval-based-Voice-Conversion-WebUI icon indicating copy to clipboard operation
Retrieval-based-Voice-Conversion-WebUI copied to clipboard

Optimizer states: important?

Open sjkoelle opened this issue 2 years ago • 1 comments

Hi,

I am running the training code locally and porting it to Ray. I've been looking to use your pretrained checkpoints from Hugging Face. Unless I am missing something, these do not include optimizer state. Is there any benefit to warmstarting with the optimizer state for finetuning?

Thanks, Sam

sjkoelle avatar May 21 '23 21:05 sjkoelle

Based on my experience, optimizer parameters are not important for fine-tuning.

RVC-Boss avatar May 24 '23 02:05 RVC-Boss