diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

[Pipelines] Add a T2I-Adapter pipeline

Open huo-ju opened this issue 3 years ago • 1 comments

Model/Pipeline/Scheduler description

T2I-Adapter is a simple and small (~70M parameters, ~300M storage space) network that can provide extra guidance to pre-trained text-to-image models while freezing the original large text-to-image models.

It has 3 pre-trained models can work with Stable Diffusion 1.4 (and other finetuned Stable Diffusion 1.4 models)

I have a basic integration StableDiffusionT2IAdapterPipeline , and I'm wondering if it is possible to contribute it become a official (or community) pipeline?

Open source status

  • [X] The model implementation is available
  • [X] The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

Official implementation of T2I-Adapter: https://github.com/TencentARC/T2I-Adapter/ Pre-trained models: https://huggingface.co/TencentARC/T2I-Adapter/tree/main/models My basic diffusers pipeline integration: https://github.com/huo-ju/diffusers

huo-ju avatar Feb 20 '23 19:02 huo-ju

Duplicated? #2390

takuma104 avatar Feb 21 '23 14:02 takuma104

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Mar 23 '23 15:03 github-actions[bot]