RealtimeSTT icon indicating copy to clipboard operation
RealtimeSTT copied to clipboard
verified publisher icon KoljaB

whisper.cpp as backend?

Open zinccat opened this issue 1 year ago • 1 comments

As mps is not currently supported for CTranslate2, is it possible to add a whisper.cpp based backend for better performance on apple metal devices? Thanks

zinccat avatar May 01 '25 00:05 zinccat

Would be nice in a non-Mac, non-Nvidia GPUs also. Pywhispercpp is almost there, but RealtimeSTT has lots of nice features on top of the Faster-Whisper model interface.

tpoindex avatar Aug 13 '25 23:08 tpoindex