InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

[enhancement]: Better prompt adherence with Ella

Open andupotorac opened this issue 1 year ago • 1 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Contact Details

No response

What should this feature add?

Integrating Ella with InvokeAI would allow us to write more detailed prompts, which are followed more closely by SD.

The only unknown I have is if Compel (which is using OpenCLIP) would work well with ELLA (which is using a t5 LLM instead of CLIP), and what approach might be taken here to improve prompt adherence while not giving up on the advanced prompting syntax.

Alternatives

No response

Additional Content

No response

andupotorac avatar Jul 31 '24 10:07 andupotorac

Link to ELLA, for ease of clicking: https://ella-diffusion.github.io/

xaroth8088 avatar Aug 05 '24 03:08 xaroth8088