Charlene Olive

In your paper and the original matlab code, you used Relu. However in this code you used Prelu

Multi-head self/ cross attention

4

Hello:) Thank you so much for sharing your code. It has been very useful in understanding the paper. There is still something I don't quite get from the paper and...