nn_pruning icon indicating copy to clipboard operation
nn_pruning copied to clipboard

Support for `BertModel`, `BartModel` (`AutoModel`)

Open kainoj opened this issue 4 years ago • 0 comments

Until now: the library supports pruning for BertFor* (AutoModelFor*). Now: you can load both BertFor* and BertModel (or just use AutoModel).

What's new: I upgraded the pattern prefix regexp so it optionally captures bert. (or model. for Bart).

  • Pattern prefixes for BertFor* start with bert.encoder.layer..
  • Pattern prefixes for vanila BertModel start with just encoder.layer..

kainoj avatar Nov 09 '21 06:11 kainoj