exo icon indicating copy to clipboard operation
exo copied to clipboard
Published 4 weeks ago • verified publisher icon exo-explore

video inference

Open padreputativo opened this issue 1 year ago • 2 comments

Could this system be used to accumulate enough RAM to run a video model like Hunyuan Video?

padreputativo avatar Jan 28 '25 18:01 padreputativo

Yes, it looks like a good fit for exo since the architecture is parallelisable and requires a lot of memory.

Image

AlexCheema avatar Jan 29 '25 00:01 AlexCheema

Are there examples of how to set up something with such a huge amount of VRAM? I don't know if it would be cheaper to combine a bunch of small phones, Raspberry Pis, or larger PCs. I have 64GB of RAM, but the model doesn't let me use it in CPU+RAM; it forces me to use CUDA and VRAM.

padreputativo avatar Jan 29 '25 07:01 padreputativo