DeepLearningExamples icon indicating copy to clipboard operation
DeepLearningExamples copied to clipboard

Finetune pretrained BERT with transformers library?

Open mscherrmann opened this issue 2 years ago • 0 comments

Hi,

I am planning to pretrain a German Bert model with own data from scratch. Before I do this with your library, I like to make sure that it is possible to load and finetune the model after pre-training using the transformers library from huggingface. Is that the case?

Thank you very much in advance!

mscherrmann avatar Jul 21 '23 09:07 mscherrmann