Alex Henry issues

Results 2 issues of


                                            Alex Henry

Hi, great work on this. Do you have any plans to add support for BPE-dropout (https://arxiv.org/pdf/1910.13267.pdf)?

Hi, do you plan to make the pretraining corpus available, or provide a way to reproduce / approximate it using Semantic Scholar?