PKD-for-BERT-Model-Compression icon indicating copy to clipboard operation
PKD-for-BERT-Model-Compression copied to clipboard
verified publisher icon intersun

Why do you set for KD.Full like this [fix_pooler=True]?

Open GeondoPark opened this issue 5 years ago • 0 comments

Hi,

Thank you for your interesting work! I just wondering why don`t you used the pooler for only KD.Full and if you use the pooler, did you initialize the pooler with BERT_teacher weight and bias?

Thank you, Sincerely,

GeondoPark avatar Aug 20 '20 10:08 GeondoPark