xtreme-dev

xtreme-dev copied to clipboard

XLM-R Hyperparameters

2

Hi @JunjieHu! I am trying to reproduce results for XLM-R. The paper suggests that lr=3e-5 and effective bs=16 should be used for XLM-R. It would be very helpful if you...

MaksymDel

Issues with download_udpos

1

Hi, I'm currently running the download script for XTREME. I'm running into some issues with the downloading and preprocessing of the UD data, and wanted to check if some of...

zphang