Cpt_Kim

Translating documents

5

Hi realated to #75 I'm interested in this project and I'm Korean. Many people in Korea (including president of Republic of Korea ) enjoys twitter. So, it might be helpful...

In Diffusion Models: Why does not use 'Positional Encoding' in self-attention layers?

1

Thx for nice practicing about DM. Actually, I'm really curious about why does not use 'Positional Encoding' (which was used in ViT or VanillaTransformer.. etc..) in self-attention layers? Is that...