diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Add option for labeled samples

Open nbardy opened this issue 3 years ago • 9 comments

The dreambooth setup can be very useful for more general finetuning as show by the community with examples such as style fine tuning.

https://twitter.com/rainisto/status/1584112851446542336

I've been using an approach adding a label per image as form of regularization, it's especially useful outside of the instance class training where the dataset is more diverse

I've been able to get some very nice wave photos with this approach https://twitter.com/NicholasBardy/status/1586065285265530880

nbardy avatar Oct 28 '22 21:10 nbardy

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

cc @patil-suraj here

patrickvonplaten avatar Nov 02 '22 16:11 patrickvonplaten

Hi, I add a --use_txt_as_label for you. And this PR is here: https://github.com/nbardy/diffusers/pull/1

CrazyBoyM avatar Nov 09 '22 10:11 CrazyBoyM

This also adds model checkpointing now.

nbardy avatar Nov 09 '22 18:11 nbardy

Gently ping again @patil-suraj

patrickvonplaten avatar Nov 09 '22 22:11 patrickvonplaten

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Regarding checkpointing @patil-suraj do we need this for dreambooth still? Think it might make sense to add it no?

patrickvonplaten avatar Nov 16 '22 16:11 patrickvonplaten

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Dec 15 '22 15:12 github-actions[bot]