ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

TomePatchModel has virtually no effect on generation speed

Open KaruroChori opened this issue 2 years ago • 1 comments

Token Merging is reported to have a meaningful impact on performance as well as the memory footprint for the model.
Still, I have not been able to replicate these results.

Even generating images with high resolution, like 1024*1024 in a batch of 4 items on a SD1.5 checkpoint, the overall time being taken is basically the same, unless I set absurd thresholds like 90%, for which I only gain a 25% boost in speed.

Do you have any experience using it, or suggestions on what might be wrong?

KaruroChori avatar Jan 16 '24 13:01 KaruroChori

I too would like to hear about experiences with this

ryanontheinside avatar Feb 17 '24 18:02 ryanontheinside