Rick Battle issues

Repositories
Issues
Comments

Results 3 issues of


                                            Rick Battle

Add support for changing the language model via a new --lm flag

System RAM usage scales linearly with GPU count

While training, the amount of system RAM used scales linearly with the number of GPUs used. If training on 1 GPU takes 64GB of system RAM, then training on 3...

Please Distill DeBERTa to MiniLMv2

**Describe** Model: I use MiniLMv2 for a lot of tasks. DeBERTa can outperform both BERT and RoBERTa. Can you please distill MiniLMv2 from DeBERTa-Large? Thank you!