ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

How to install deforum on comfyui

Open ca3gamedev opened this issue 2 years ago • 8 comments

Hi, just want to know how to make animations in comfyui.

ca3gamedev avatar Aug 06 '23 20:08 ca3gamedev

no way of doing this right now

jaideep2 avatar Aug 15 '23 16:08 jaideep2

https://github.com/alt-key-project/comfyui-dream-project - just found this in the same search that brought me to this issue, haven't played with it myself yet

sanguivore-easyco avatar Sep 20 '23 17:09 sanguivore-easyco

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

jaideep2 avatar Sep 20 '23 18:09 jaideep2

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

sanguivore-easyco avatar Sep 20 '23 20:09 sanguivore-easyco

Agreed! Let me know if you happen to come across anything with SDXL. I am currently using https://github.com/neggles/animatediff-cli because it works with my GPU that has 12GB VRAM.

jaideep2 avatar Sep 26 '23 19:09 jaideep2

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

You can change the output for mp4 or some other options. But agree no sdxl is a shame

aleatorydialogue avatar Dec 03 '23 01:12 aleatorydialogue

Hey @sanguivore-easyco looks promising, but I see the image gets darker and darker because of the design choices. Here is another one that uses a different approach https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

My main issue with this one is that it doesn't seem able to support SDXL and exports its results as gifs with lots of visual artifacts (that and I do really like the ability to music-sync things like in deforum, which I don't think AnimateDiff can support)

You can change the output for mp4 or some other options. But agree no sdxl is a shame

There's a more recent model for SDXL support in the huggingface repo for AnimateDiff now: https://huggingface.co/guoyww/animatediff/tree/main cc @jaideep2

And also with the help of https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite and ControlNets, you could possibly sync with music like Deforum in a sense.

sanguivore-easyco avatar Dec 04 '23 16:12 sanguivore-easyco

Check our new Deforum Node package here: https://github.com/XmYx/deforum-comfy-nodes

XmYx avatar Feb 12 '24 09:02 XmYx