MiniCPM-V icon indicating copy to clipboard operation
MiniCPM-V copied to clipboard
Published 4 months ago • verified publisher icon OpenBMB

fast MiniCPM-o deployed endpoint (3x faster inference)

Open altairmn opened this issue 10 months ago • 2 comments

We have optimized MiniCPM-o and created fast MiniCPM-o with ~3x inference speed for voice-to-voice chat. You can try it out here: https://demo.outspeed.com/

altairmn avatar Mar 26 '25 15:03 altairmn

速度确实很快，具体做了哪些优化呢？

kanghua309 avatar Apr 09 '25 08:04 kanghua309

I would also like to know.

JIA-HONG-CHU avatar Apr 22 '25 03:04 JIA-HONG-CHU