diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard
Published 3 months ago • verified publisher icon huggingface

support kolors with controlnet and ipadapter-Faceid

Open akk-123 opened this issue 1 year ago • 5 comments

please support kolors with controlnet and ipadapter-Faceid

akk-123 avatar Aug 29 '24 10:08 akk-123

Hi, we currently don't have the bandwidth for this, but anyone from the community is free to open a PR to support them.

Since it's the same SDXL arch, it should be pretty straightforward and easy to implement.

asomoza avatar Aug 29 '24 11:08 asomoza

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Sep 28 '24 15:09 github-actions[bot]

Hi, we currently don't have the bandwidth for this, but anyone from the community is free to open a PR to support them.

Since it's the same SDXL arch, it should be pretty straightforward and easy to implement.

Hi @asomoza, could you provide some good pointers for implementing this?

I would appreciate your support

hosjiu1702 avatar Sep 29 '24 03:09 hosjiu1702

Hi, kolors custom code is based on diffusers, but we don't have support for either of them, the easier one should be FaceID

  1. Read their implementation.
  2. Check the differences, there shouldn't be that many over the IP Adapter we already have.
  3. Open a PR and implement them, we can help you with the implementation if you find any problems that you can't solve.

I haven't read the code but I find it strange that they did a custom pipeline for each ip adapter which can be a problem, the one we have here can be used with any kolors pipeline so you'll need to solve that part.

After that, you can do the same with controlnet in a separate PR to make it easier to review, they only did the img2img one, so you'll need to adapt it for t2i too.

asomoza avatar Sep 29 '24 04:09 asomoza

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Oct 23 '24 15:10 github-actions[bot]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Nov 17 '24 15:11 github-actions[bot]