[Question] how to export huggingface whisper models to onnx ?

[eix128]

On huggingface , we need to use some safetensors file here : https://huggingface.co/openai/whisper-large-v3-turbo

how can we convert these models to onnx that is compatible with this library ?

Also for NLLB onnx

We need to fine tune and change onnx files. But your onnx files different from whisper turbo v3 models

[niedev]

Hi, in the next week I will probably write an article on how I converted whisper in onnx and optimized it. In the meantime you can check here for some details.

[laixiaofeng0]

@niedev Hello, do you have any plans to release the Whisper model converted to ONNX? I’m very eager to know. Thank you.

[niedev]

@laixiaofeng0 all the models used by RTranslator are here in the assets.

[Eric-Edf]

Hi, in the next week I will probably write an article on how I converted whisper in onnx and optimized it. In the meantime you can check here for some details.

Hi, author. First of all, thank you for this wonderful project.

Could I ask when you will release the "article" about converting whisper in onnx (including kv-cache and quantization)? since I want to load my fine-tuned whisper model into R-translator.

[niedev]

@Eric-Edf Thank you! I haven't had much time lately so I haven't even managed to start it, sorry, but as soon as I can do it I'll link it here

[Eric-Edf]

@Eric-Edf Thank you! I haven't had much time lately so I haven't even managed to start it, sorry, but as soon as I can do it I'll link it here

Thank you for your reply. Looking forward to it!

[tianxing1234-coder]

Could you please write it quickly? I need him very much. Thank you.@niedev

[niedev]

@tianxing1234-coder the quick version is here

[Geministudents]

@tianxing1234-coder the quick version is here

Looking forward ！！！！！！！！！！！！！！！！ NLLB and whisper ！！！！！ Convert to onnx model and quantize！！！！

[niedev]

@Geministudents I was about to direct you here, let me know how it goes 🚀