fairseq2 icon indicating copy to clipboard operation
fairseq2 copied to clipboard
verified publisher icon facebookresearch

Write w2v-BERT pretraining recipe

Open cbalioglu opened this issue 2 years ago • 3 comments

As the second recipe after NLLB, write the w2v-BERT (and wav2vec2) pretraining recipe for users to check out. This will likely branch to several subtasks once we start working on it.

cbalioglu avatar Feb 07 '24 14:02 cbalioglu

@cbalioglu any progress on pre-train or finetune w2v bert recipe?

seastar105 avatar Mar 06 '24 14:03 seastar105

Hi @cbalioglu, Any update on this... We want to do the continual training of w2v-bert on specific Indic low-resource languages on audio-only data. Any suggestion on how should we approach this?

kdcyberdude avatar May 12 '24 20:05 kdcyberdude