mlx-examples icon indicating copy to clipboard operation
mlx-examples copied to clipboard

Text to Speech MLX model.

Open javileyes opened this issue 1 year ago • 1 comments

There are MLX models for text generation (llama 3) and for text recognition (whisper) but I think that to have a complete NLP environment it would be necessary to create a text to scpeech MLX. How would it be possible to create, for example, an MLX model of facebook/fastspeech2-en-ljspeech?

javileyes avatar May 09 '24 09:05 javileyes

It should be possible. There is a port of Suno's Bark model already: https://github.com/j-csc/mlx_bark

I think it still depends on PyTorch for the encodec model though.

awni avatar May 09 '24 13:05 awni