Question on attention mask type

Open makeme-zgz opened this issue 3 years ago • 1 comments

Thanks for the paper and code! I'm curious on how causal masking and bidirectional masking perform differently in motion diffuse.

Oct 06 '22 15:10 makeme-zgz

Thanks for the paper and code! I'm curious on how causal masking and bidirectional masking perform differently in motion diffuse.

Here we use mask only to eliminate the influence of zero padding. As for valid frames, we consider relationships between all pairs.

Oct 07 '22 02:10 mingyuan-zhang