Dataset-Diffusion icon indicating copy to clipboard operation
Dataset-Diffusion copied to clipboard

Class prompt cross attention

Open Jumponthemoon opened this issue 1 year ago • 0 comments

Hi,

It is an interesting and amazing work!

I have a question about the cross-attention part in the code. I see there are two line to get self-attention and cross-attention by passing the parameter 'res': image In the paper, you mention that the cross-attention is extracted for the class prompt. I checked detail in the 'Class StoredAttnClassPromptsProcessor', but didn't find the clue that indicates the code extracts the cross attention for the class prompt rather than the caption prompt. Please help me.

Thanks!

Jumponthemoon avatar Apr 12 '24 10:04 Jumponthemoon