diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Various Fixes for Flax Dreambooth

Open yasyf opened this issue 3 years ago • 3 comments

  • Correctly update the progress bar every epoch
  • Allow specifying a pretrained VAE
  • Allow specifying a revision to pretrained models
  • Cache compiled models between invocations (speeds up TPU execution a lot!)
  • Save intermediate checkpoints by specifying save_steps

yasyf avatar Dec 20 '22 06:12 yasyf

cc @patrickvonplaten @yiyixuxu @patil-suraj

yasyf avatar Dec 20 '22 06:12 yasyf

The documentation is not available anymore as the PR was closed or merged.

the fixes seem pretty good to me.

asking @pcuenca to take a look :)

I was just thinking about adding the revision argument (the original script does not cast the weights to bf16 when we pass --mixed_precision=bf16)

yiyixuxu avatar Dec 20 '22 15:12 yiyixuxu

I'm not actually sure why the tests are failing.. can't figure out if its sporadic or real. Any thoughts @pcuenca?

yasyf avatar Dec 21 '22 07:12 yasyf

@patil-suraj should be good now!

yasyf avatar Jan 01 '23 01:01 yasyf

Thanks a lot @yasyf

patrickvonplaten avatar Jan 04 '23 21:01 patrickvonplaten