onnxruntime icon indicating copy to clipboard operation
onnxruntime copied to clipboard
verified publisher icon microsoft

[ROCm] add SkipLayerNorm vectorize Regular case

Open PeixuanZuo opened this issue 3 years ago • 0 comments

Description: Describe your changes. Related PR: https://github.com/microsoft/onnxruntime/pull/12803 https://github.com/microsoft/onnxruntime/pull/12816 https://github.com/microsoft/onnxruntime/pull/12817 add SkipLayerNorm vectorize regular case

  1. when hidden size <= 1024, SkipLayerNormTunable op can use both small case and regular case
  2. when hidden size > 1024, SkipLayerNormTunable op can only use regular case.

Motivation and Context

  • Why is this change required? What problem does it solve?
  • If it fixes an open issue, please link to the issue here.

PeixuanZuo avatar Sep 01 '22 06:09 PeixuanZuo