DeBERTa icon indicating copy to clipboard operation
DeBERTa copied to clipboard
verified publisher icon microsoft

[WIP] ONNX conversion

Open ganik opened this issue 5 years ago • 1 comments

Changes needed to convert DeBerta to ONNX

ganik avatar Jul 20 '20 22:07 ganik

Instead of change code every where, why not just change StableDropout?

Previous iterations i tried to redefine StableDropout to inherit from nn.Dropout, but it led to regression in model stats. Could not figure out why. If i do change this way there is no regression. Something was missing with just redefining StableDropout.

ganik avatar Aug 14 '20 19:08 ganik