CosyVoice icon indicating copy to clipboard operation
CosyVoice copied to clipboard

Some questions about flow

Open howitry opened this issue 1 year ago • 4 comments

This is an amazing open source project! Why is the flow decoder used in cosyvoice much larger than the matcha-TTS decoder? What is the purpose of increasing the decoder? Is it to improve the sound quality or zero-shot performance?

howitry avatar Aug 30 '24 12:08 howitry

we use speech tokenizer, which means we must use flow model to reconstruct the mel sequence

aluminumbox avatar Sep 03 '24 05:09 aluminumbox

we use speech tokenizer, which means we must use flow model to reconstruct the mel sequence

I understand that flow is used to transform code to mel. But the flow decoder used in the matcha-TTS(https://github.com/shivammehta25/Matcha-TTS/blob/main/configs/model/decoder/default.yaml) is much smaller than that of cosyvoice. I want to know the reason for increasing the flow decoder.

howitry avatar Sep 03 '24 06:09 howitry

I have the same confusion.

huskyachao avatar Sep 05 '24 12:09 huskyachao

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] avatar Oct 06 '24 02:10 github-actions[bot]