collage-diffusion icon indicating copy to clipboard operation
collage-diffusion copied to clipboard

About Textual Inversion Embedding

Open YouPassTheButter opened this issue 2 years ago • 3 comments

Hi, great job! Would you mind sharing the code or pipeline for training the textual inversion embedding?

YouPassTheButter avatar Jun 19 '23 07:06 YouPassTheButter

Hi, @VSAnimator

I'd like to know about training textual inversion too. In particular, I'd appreciate details regarding the FineTuneConcept class shown in the notebook. Thanks!

shunk031 avatar Aug 19 '23 06:08 shunk031

Maybe we can follow this demo to train a Textual Inversion model with a size of [1024]: https://github.com/huggingface/diffusers/tree/main/examples/textual_inversion

cangzihan avatar Nov 16 '23 07:11 cangzihan

The textual inversion used in FTC seems to be different original textual_inversion, I used the textual inversion code base to learn but it would take a lot of time for each layer. Here in the assets shared, it seems like they are not learning a new token - but instead a modifier on top of layer token. I am not sure how this is being done but seems very cool thing to try out

diptanshu-singh avatar Feb 16 '24 21:02 diptanshu-singh