StableCascade icon indicating copy to clipboard operation
StableCascade copied to clipboard

In the gradio_app/app.py load one model at a time

Open another-ai opened this issue 1 year ago • 1 comments

In the gradio_app/app.py: 1- load one model at a time, 2- c_dtype = torch.bfloat16 3- miss a generator=generator on def generate_prior(...) as an example see: https://github.com/another-ai/stable_cascade_easy With a nvidia rtx 3060 12 gb vram: 10 minutes vs 44 seconds

another-ai avatar Feb 15 '24 22:02 another-ai

we have amazingly optimized app which even works at 8gb gpus

https://github.com/Stability-AI/StableCascade/issues/125

FurkanGozukara avatar Mar 22 '24 03:03 FurkanGozukara