stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

[feature] add support for AltDiffusion/AltDiffusion-m9

Open marscrazy opened this issue 3 years ago • 2 comments

We add support for AltDiffusion, which alters the text encoder of stable diffusion to extend the supported languages.

  1. AltDiffusion uses the xlmr-large as the text encoder and supports both English and Chinese.
  2. AltDiffusion-m9 also uses the xlmr-large as the text encoder and supports English(En), Chinese(Zh), Spanish(Es), French(Fr), Russian(Ru), Japanese(Ja), Korean(Ko), Arabic(Ar) and Italian(It).

References:

  • AltDiffusion: https://huggingface.co/BAAI/AltDiffusion
  • AltDiffusion-m9: https://huggingface.co/BAAI/AltDiffusion-m9
  • paper:https://arxiv.org/abs/2211.06679

marscrazy avatar Nov 27 '22 07:11 marscrazy

This PR also fix ISSUE #495

marscrazy avatar Nov 27 '22 07:11 marscrazy

You can also quite easy use it with diffusers: https://huggingface.co/BAAI/AltDiffusion-m9

patrickvonplaten avatar Mar 08 '23 10:03 patrickvonplaten