dash-infer icon indicating copy to clipboard operation
dash-infer copied to clipboard
Published 5 months ago • verified publisher icon modelscope

Add Support for mac armv9 support, with A16W8 quantization.

Open kzjeef opened this issue 11 months ago • 1 comments

  • need port to mac (M4 + ) ARMv9
  • disable openMP (because default xcode clang not support openMP)
  • enable a16w8 quantization support to reduce RAM requirement.

kzjeef avatar Feb 07 '25 02:02 kzjeef