Bert-Multi-Label-Text-Classification icon indicating copy to clipboard operation
Bert-Multi-Label-Text-Classification copied to clipboard
verified publisher icon lonePatient

Updating to pytorch-transformers

Open desireevl opened this issue 6 years ago • 1 comments

Fix to #14. I believe that this should update the things that have changed from the migration from pretrainedbert to pytorch-transformers. This update runs fine for me using the toxic Kaggle dataset however, I think there may be some other things in trainer.py that I have missed.

Also in bert_fine.py, I have commented out output_all_encoded_layers in the forward function as I'm not sure how to include this

desireevl avatar Aug 09 '19 01:08 desireevl

Thank you! By the way, focal loss is better than BCE loss, especially for hundreds of labels

maxware0715 avatar Aug 19 '19 08:08 maxware0715