bugfix: qk_scale is not used by swin FMHA.

Open cyfwry opened this issue 3 years ago • 2 comments

Fixed issue #322. Now qk_scale can be used by swin FMHA.

Signed-off-by: liangtao07 [email protected]

Sep 20 '22 08:09 cyfwry

There are some other bugs, so I create another PR https://github.com/NVIDIA/FasterTransformer/pull/324, you can try it.

Sep 20 '22 10:09 byshiue

There are some other bugs, so I create another PR #324, you can try it.

OK, Swin FMHA can work correctly now, thanks!

Sep 26 '22 06:09 cyfwry