DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

pre/post forward calls to engine + generate method

Open jeffra opened this issue 2 years ago • 0 comments

  • [x] add pre/post forward methods
  • [x] add generate method if the wrapped module has this attribute
  • [ ] add documentation for new pre/post forward calls to RTD

Partially addresses issues discussed in #1915

/cc @stas00, @VictorSanh

jeffra avatar Feb 14 '23 21:02 jeffra