ControlNet on other diffusion backbones as opposed to Stable diffusion

[xcharxlie]

HI There. Thanks for your great work and there is a lot of fun. I'm just curious if you have tried it on different diffusion backbones for generalization? We now have a diffusion model which is not U-Net likewise, I wonder if ControlNet also works in this case?

[shravankumar147]

Any references that you can point to?

[geroldmeisinger]

support for Würstchen would be nice! :) https://huggingface.co/blog/wuerstchen https://github.com/huggingface/diffusers/issues/5071

[mayank64ce]

Any references that you can point to?

https://guytevet.github.io/mdm-page/ uses a transformer based denoiser.