speech encoder integration

[pavanbaswani]

Hi,

I would like to know, the possibilities for integrating the speech encoder to turn this model input Speech + Text input instead of Text only input. Any information regarding the integration of speech encoder or trainining with speech instructions would really helpful a lot.

Thanks & Regards, Pavan.