diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

dreambooth: add support for .txt captions for instance images

Open timh opened this issue 3 years ago • 4 comments

Not sure if instance captions are desired on the main dreambooth example, but this is what I've been using locally. FWIW, I haven't gotten great results with captions so far, which are mostly runs with 20-50 images of a person.

timh avatar Dec 12 '22 18:12 timh

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Dreambooth is meant to be used on a single token, with prior loss preservation

devilismyfriend avatar Dec 13 '22 19:12 devilismyfriend

This use case is a bit too exotic IMO to merge in to "main". We cannot maintain all kinds of extensions of dreambooth here sadly.

@pcuenca what do you think?

patrickvonplaten avatar Dec 19 '22 12:12 patrickvonplaten

@patrickvonplaten I agree, I think it's a bit too specific. The training scripts are in my opinion meant to be examples, so people are free to extend and modify them to suit their needs, just as you did here @timh.

It's an interesting experiment, though, curious to know if you end up having good results, @timh :)

pcuenca avatar Dec 19 '22 12:12 pcuenca

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jan 12 '23 15:01 github-actions[bot]