ComfyUI-CogVideoXWrapper icon indicating copy to clipboard operation
ComfyUI-CogVideoXWrapper copied to clipboard

What method is needed to drop fps to increase video length?

Open DuckersMcQuack opened this issue 1 year ago • 10 comments

Or can the video only last for 2 seconds? As i've tried 12 fps and 24 fps, both times it's the same duration.

DuckersMcQuack avatar Nov 09 '24 00:11 DuckersMcQuack

2 ways to extend the length of the video: a) reduce the fps parameter in videocombine node b) use frame interpolation to increase the number of frames in the video both of these methods slow down the motion.

cheezecrisp avatar Nov 09 '24 03:11 cheezecrisp

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

DuckersMcQuack avatar Nov 09 '24 23:11 DuckersMcQuack

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

I don't think there is a way to do that. But you can use the last frame in the video to generate another video and then concatenate them together.

cheezecrisp avatar Nov 10 '24 02:11 cheezecrisp

Ah ok, so model is strictly intended for 2 second videos? can't do half fps to last twice as long for instance?

I don't think there is a way to do that. But you can use the last frame in the video to generate another video and then concatenate them together.

True. I need to see if it will result like animatediff models where last frame of the first video with the same seed will result in a X amount of second "still image video" lol. As i setup a train of 10 video gens to make up a combined 10 sec video xD

Or was it a whole damn minute i had a train for lol.

DuckersMcQuack avatar Nov 11 '24 04:11 DuckersMcQuack

Don't use the same seed. It works as cheezecrisp said. I have 1 minute and 39 secs so far with a fluid anime sequence. I told you the process in the other thread. It just needs a bit of color correction between the segments.

zazoum-art avatar Nov 11 '24 05:11 zazoum-art

i2v.json

Here is the workflow. With no surprise it is the basic workflow with a bit of help of Flowrense-2. I can't post the whole sequence here cause the github limit is 10MB. Give me a few moments to cut 2 characteristic raw low-res un-enchanched unedited sequences (not properly edited in a professional film direction manner).

zazoum-art avatar Nov 11 '24 06:11 zazoum-art

https://github.com/user-attachments/assets/782b6ef4-dbca-4601-8ee2-34957744681e

Here's an Enki-bilal dystopian style shot unedited. It is 22 secs and that's 4 clips of cogvideo, not 22. It is static camera following the woman, cause well, thats enki bilal.

Give me a few moments to cut a dynamic movement one.

zazoum-art avatar Nov 11 '24 06:11 zazoum-art

https://github.com/user-attachments/assets/e67cea2a-d665-49cf-ac4b-71920afe7ca8

Here's a more dramatic one. 17secs

Of course you can't present these on festivals as they are. You have to edit the momentum and change the RGB properties. I use Premiere Pro. But as you can see the transitions are fluid.

The ugly faces, the upscaling, the enchancement, blurriness, sharpness etc. are easily dealt with Topaz Video AI. They can be converted to crystal clear 8K resolution videos with all distortions fixed in under 2 minutes of 4090 process I think.

zazoum-art avatar Nov 11 '24 06:11 zazoum-art

FYI by default both the models, video and the img2vid (fun versions as well!) are 6 sec default so if yours are 2 sec then the basic settings are off.

on the output node there is a FPS setting and essentially without touching anything else (the frame interpol works as well but you need video math to get it right) by increasing the fps here you will SHORTEN the video to 4 sec (8fps = 6 sec, 10fps = 4 sec, and 6fps will make 8 sec yada yada) but then you are dealing with a slow fps video, and need topazai or adobe premiere to "fix" the entire thing.

My videos are too big for github here, but you might have seen me posting large ones around certain discord model ai channels already. I leave my settings at 8fps and then post process after.

This is a RAW example - default 6 sec to show you. [ The full video I was making is over 2min so far with over 60 spliced videos to combine into a fun racing glory demo]

https://github.com/user-attachments/assets/c15d2c1c-a9aa-400e-b60b-3286559fbd3b

KrakeyMTL avatar Nov 11 '24 16:11 KrakeyMTL

I just tested with a fresh install on one of my new servers and can confirm that yes, 6 sec default on clean!

https://github.com/user-attachments/assets/5271b6aa-42d6-4056-8f7d-09e393054825

KrakeyMTL avatar Nov 11 '24 16:11 KrakeyMTL