Suggestion: Add GPT-NeoX 20B support

Open ElleLeonne opened this issue 2 years ago • 0 comments

JAX is already a library that is optimized for GPU training, and the NeoX repo itself already requires significant GPU resources that could benefit from offloading.

Feb 21 '23 00:02 ElleLeonne