functional-transformer
functional-transformer copied to clipboard
Add non-learned position encodings
From https://github.com/awf/functional-transformer/discussions/4#discussioncomment-2834638_
See how we might include the sin(t) terms, rather than just 'learned' encodings.