[Feature Request]: Readme should state MiniCPM does not support macOS

Open jazelly opened this issue 1 year ago • 1 comments

Feature request / 功能建议

Hi, I was trying to get this up running on my macOS, and found this. Since there is a dependency to xformers, I think MiniCPM cannot support macOS as well?

Feb 02 '24 05:02 jazelly

Hi, there are some bugs now when running on cpu machines. We are working on it, please stay tuned.

Feb 02 '24 14:02 SUDA-HLT-ywfang

Hello @jazelly, Running minicpm on Mac can use LLMFarm-MiniCPM.

Feb 04 '24 03:02 zkh2016

Hi, we have fixed the bug that MiniCPM cannot run on macOS. For current version, please install cpu version (or mps version) torch and run MiniCPM with float32 precision on cpu, using huggingface transformers. MiniCPM can run on Mac without xformers.

Feb 05 '24 11:02 huangyuxiang03