ONE icon indicating copy to clipboard operation
ONE copied to clipboard

[onert] Enhance xnnpack backend

Open YongseopKim opened this issue 5 years ago • 2 comments

(Related issue: https://github.com/Samsung/ONE/issues/4968)

Enhance xnnpack backend by supporting various features, ops, and datatypes.

features

  • [x] Remove permutation #5186
  • [ ] Release unused const tensors

ops

  • [x] FC #5210
  • [ ] ADD/MUL/SUB/DIV for 2d
  • [ ] RESHAPE for static
  • [ ] SIGMOID

(unfortunately, reduce_mean op is not there.)

datatypes

  • fp16
  • q8

etc.

  • Enable build on x64

YongseopKim avatar Nov 27 '20 02:11 YongseopKim

/cc @chunseoklee and @periannath

YongseopKim avatar Nov 27 '20 02:11 YongseopKim

Sigmoid (defined as logistic in ONE runtime) might be a good candidate operation since it takes a substantial portion in some models.

periannath avatar Nov 27 '20 02:11 periannath