tango icon indicating copy to clipboard operation
tango copied to clipboard
verified publisher icon declare-lab

Sound cloning

Open darkman111a opened this issue 2 years ago • 0 comments

I'm looking to build on your research. I understand this isn't the scope of your project. Just curious for an interesting. Just wanted the thoughts of the creators. I want to retrain and repuprose and expertiment with this for expressive TTS instead of generic . I'm somewhat new to working with these models.

OBJECTIVES ->

  1. retrain on a more dynamic dataset
  2. synthetic dataset -> speech/text[w/special utterences]{real speech/lofi speech from 'BARK'}, speech w/synthetic audio envirnoments generated by 'tango'/text[I have a rather large dataset]

EXPECTATATIOS ->

  1. most expressive hybrid TTS[TTS with semantic conditioned background environments]

QUESTIONS ->

  1. what are your thought on approaching voice cloning with this style of architecture? I figure I should approach like inpainting?
  2. If possible, wouldn't it clone any artifact contained in the speech audio?

CLOSING THOUGHTS -> I'm opening to sharing my results with you guys privately. Appreciate your contribution to the community.

darkman111a avatar May 03 '23 15:05 darkman111a