Swin-Transformer icon indicating copy to clipboard operation
Swin-Transformer copied to clipboard
verified publisher icon microsoft

Questions about relative position bias

Open qkdkralsgh opened this issue 2 years ago • 0 comments

I am researching by visualizing the attention map of Swintransformer.

Even if there is no object at the corner of the image, attention is received.

I think it is because of the relative position bias.

Why is that?

qkdkralsgh avatar Apr 06 '23 02:04 qkdkralsgh