Druva24

[BERT/PyTorch] How can we use create_datasets_from_start.sh for BERT pretraining

1

Related to **Model/Framework(s)** *(e.g. GNMT/PyTorch or FasterTransformer/All)* BERT/PyTorch In Readme.md of https://github.com/NVIDIA/DeepLearningExamples/tree/master/PyTorch/LanguageModeling/BERT it is mentioned that on running create_datasets_from_start.sh, it will generate pretraining dataset for BERT. However whenever I tried...

Unable to understand throughput calculation

3

Within `run_squad.py` we have two cases based on args.max_steps https://github.com/NVIDIA/DeepLearningExamples/blob/master/PyTorch/LanguageModeling/BERT/run_squad.py#L1198 I just want to understand in else case what are we trying to do, because I have tried 3 experiments...