Finetuning whisper

[AmgadHasan]

Hi

Thank you so much for open sourcing this amazing project.

Is it possible to add support for whisper (you can think of it as a multimodal LLM)

[RdoubleA]

Hi,

Thanks for the request. Multimodal support is in our medium term plan. In the short term up until release we are focused on supporting text-based LLM fine-tuning.