DeepLearningExamples
DeepLearningExamples copied to clipboard
Bert PyTorch for LaunchPad
There is an example of running PyTorch BERT on LaunchPad here: https://docs.nvidia.com/launchpad/ai/prod_base-command-nlp.html
That example uses an older version of PyTorch BERT code (prior to LDDL and other updates). I added a script "run_bcp.sub" that is updated to match the current code. This script can be run on LaunchPad (BCP) with single node and multi node jobs. Refer to "README_BCP.md" for instructions.