uda icon indicating copy to clipboard operation
uda copied to clipboard

How to configure num_train_steps of BERT model in UDA?

Open pnhuy opened this issue 6 years ago • 2 comments

Hi team,

Thanks for releasing this awesome paper and code.

I am wondering about how to configure the BERT hyperparameter in UDA. Particularly, if previous BERT model required the 3 epochs of training; so how many is equivalent num_train_steps in UDA?

Thanks for your support.

pnhuy avatar Nov 20 '19 08:11 pnhuy

num_train_steps = int(len(train_examples) / train_batch_size * num_train_epochs)

Ritali avatar Jan 02 '20 06:01 Ritali

Same question.

guotong1988 avatar Jun 05 '20 02:06 guotong1988