AzureML-BERT icon indicating copy to clipboard operation
AzureML-BERT copied to clipboard
verified publisher icon microsoft

Dedicated vs. Low-priority servers

Open rzhao01 opened this issue 6 years ago • 0 comments

Hi, I just have a question. Does this code handle being pre-empted on Azure ML low-priority VMs? I've read that BERT is particularly sensitive and requires the model, optimizer state, and dataset shuffling to all be saved and restored if pre-empted during pre-training.

rzhao01 avatar Oct 07 '19 18:10 rzhao01