Transformer_Relative_Position_PyTorch
Transformer_Relative_Position_PyTorch copied to clipboard
Why output sentence always repeat?
example hypothesis: this man was mahhhhnenearararari.
example hypothesis: if we can stand in the next 150 years, i think our ururururururge.
I train 30epoch but only get 11BLUE....
sould I train more epoch?
Any suggest that will solve the problem?
I follow the orig paper setting max_relative_position=16