diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Reduce Imagic Pipeline Memory Consumption

Open andreemic opened this issue 3 years ago • 1 comments

I'm running the Imagic Stable Diffusion community pipeline and it's routinely allocating 25-38 GiB GPU vRAM which seems excessively high.

@MarkRich any ideas on how to reduce memory usage? Xformers and attention slicing brings it down to 20-25 GiB but fp16 doesn't work and memory consumption in general seems excessively high (trying to deploy on serverless GPUs)

andreemic avatar Jan 16 '23 23:01 andreemic

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Feb 16 '23 15:02 github-actions[bot]