diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard
Published 2 months ago • verified publisher icon huggingface

simplyfy AttentionBlock

Open patil-suraj opened this issue 3 years ago • 1 comments

This simplifies AttentionBlock by always making q,k,v a 3D tensors like we do in CrossAttention. This way we can also leverage sliced attention and xformers attention in this block.

patil-suraj avatar Nov 30 '22 15:11 patil-suraj

The documentation is not available anymore as the PR was closed or merged.

HuggingFaceDocBuilderDev avatar Nov 30 '22 15:11 HuggingFaceDocBuilderDev

I assume all the model slow tests are passing? Merging and will check then

patrickvonplaten avatar Dec 01 '22 15:12 patrickvonplaten