lbann icon indicating copy to clipboard operation
lbann copied to clipboard
verified publisher icon LLNL

Adds Distconv support for Layer Normalization layer

Open szaman19 opened this issue 2 years ago • 2 comments

Adds distconv support for layer normalization

  • [x] Add CI test
  • [x] Implement layer_norm_distconv_adapter
  • [x] Move layer norm kernels to shared .cuh file
  • [x] Use existing layer norm kernels to implement distconv layer norm operator

szaman19 avatar Mar 15 '23 19:03 szaman19

Tagging @tbennun @benson31 @bvanessen

szaman19 avatar Dec 04 '23 18:12 szaman19

Tagging @tbennun @benson31 @bvanessen

Please fix the conflicts :)

tbennun avatar Dec 04 '23 18:12 tbennun