Shantanu Agarwal

Update download.sh

1

Hi Kyubyong, Thanks for the amazing work. The directory structure of NeuroNER's repository seems to have changed. This commit is to point train/valid/test.txt files to the correct location.

Support for Arabic

2

Hi @bowbowbow, thanks a lot for putting this together. Was wondering if it will be easy to extend the content in main.py to support Arabic. In my initial trials, I...

Hi @husseinmozannar , thanks a lot for sharing the code and the data. Had a small question regarding Arabic-Squad: In the [paper](https://arxiv.org/pdf/1906.05394.pdf), it is mentioned that `Arabic-SQuAD is split 80-10-10%...

Training script

2

Thanks a lot for the great work. It would immensely benefit the community if the training script (exact script used for orchestrating the training of the `JetMoE-8B` model) is made...

MNTP learning rate

1

Great work. Really appreciate that the code is public (and also the paper is so clearly written). I had a question about the MNTP config. Can you please confirm what...