Minerva

Wav2vec with LM

5

Hi, I have read the wav2vec recipe for CV dataset and I was wondering if there are any implementation and experiments that had wav2vec alongside a Transformer LM ?! Does...

Electra-small pretraining

1

Hey, I want to pretrain and benchmark small and base versions of Electra for the Arabic and Persian languages. As mentioned in the run_pretraining python file, only "base" and "large"...