Taejune Kim

Question about implementation of sinusoidal positional embedding

2

Is there any reason why not shuffling sin and cos values when calculating positional embedding? Because to the best of my knowledge, "attention is all you need" used shuffled sinusoidal...

Issues about Positional Embedding and Reference Point

1

Hi, thanks for sharing your wonderful work. I got a question in here, https://github.com/Atten4Vis/ConditionalDETR/blob/ead865cbcf88be10175b79165df0836c5fcfc7e3/models/transformer.py#L33 which embedes positional information in the query_pos. however, I don't understand the reason why does ```2*(dim_t//2)```...