ViktorThink

Is the 13B - unmodified Megatron gpt2 - baseline available? ( tr1-13B-base)

1

I was super excited to hear about this project! I was wondering if the model is available anywhere? In the [chronicles of tr1-13B-base](https://github.com/bigscience-workshop/bigscience/blob/master/train/tr1-13B-base/chronicles.md ) it says at the end: "All...