Mehrad Moradshahi
Mehrad Moradshahi
## How to reproduce First of all, thanks for this great project! I'm facing an issue running the test code provided [here](https://github.com/tunib-ai/parallelformers/blob/main/tests/seq2seq_lm.py) on Kubernetes. This is what I'm running inside...
Through several rounds of changes we've made so far, the generic datasets (originally part of decaNLP) cannot be loaded properly in genienlp anymore and should be fixed. Also, many of...
Huggingface recently started support for [DeepSpeed](https://github.com/microsoft/deepspeed) and [FairScale](https://github.com/facebookresearch/fairscale/) which supposedly give major speedups in both multi-gpu and single-gpu settings. The feature is still experimental but worthwhile to look into and...