MIGC icon indicating copy to clipboard operation
MIGC copied to clipboard
verified publisher icon limuloo

Inference Time

Open Hammour-steak opened this issue 1 year ago • 4 comments

I tried to generate a single image on my PC, it takes about 7 min on the single RTX 2060, is this normal？

Hammour-steak avatar May 27 '24 06:05 Hammour-steak

@Hammour-steak We haven't tested it on 2060 yet. Have you tested the speed of running stable diffusion directly on your device? I think you can compare the speed of stable diffusion to determine whether there is a problem.

limuloo avatar May 27 '24 06:05 limuloo

Is it convenient that you can provide what and how many gpu you tested? Thank you

Hammour-steak avatar May 27 '24 06:05 Hammour-steak

@Hammour-steak It only takes about 10 seconds on both RTX 3090 and V100. It takes 30 seconds on a T4 GPU. You can verify this through our colab demo. https://colab.research.google.com/drive/1rkhi7EylHXACbzfXvWiblM4m1BCGOX5-?usp=sharing

limuloo avatar May 27 '24 06:05 limuloo

Thank you for your reply, I'll check it again.

Hammour-steak avatar May 27 '24 07:05 Hammour-steak