functional-transformer icon indicating copy to clipboard operation
functional-transformer copied to clipboard
verified publisher icon awf

Add non-learned position encodings

Open awf opened this issue 3 years ago • 0 comments

From https://github.com/awf/functional-transformer/discussions/4#discussioncomment-2834638_

See how we might include the sin(t) terms, rather than just 'learned' encodings.

awf avatar May 27 '22 14:05 awf