Transformer icon indicating copy to clipboard operation
Transformer copied to clipboard

A pytorch implementation of Attention is all you need

Results 2 Transformer issues
Sort by recently updated
recently updated
newest added

in transformer.py whether "context_attn_mask = padding_mask(tgt_seq, src_seq)" is correct, I think it should be the expand of src_mask.

https://github.com/pengshuang/Transformer/blob/6c15c64d352b63bf86e2afd671e6f40a5d929bf1/util.py#L200 感谢,看你的代码很好地理解了Transformer,注释很棒。