add get_fused_optimizers

Open YLGH opened this issue 3 years ago • 1 comments

Summary: Since we no longer rely on DistributedModelParallel (for composability piece), we need an alternative way of getting the fused optimizer. get_fused_optimizer implements this, logically it's the same as the recursive call in DMP

Differential Revision: D37505229

Aug 01 '22 20:08 YLGH

This pull request was exported from Phabricator. Differential Revision: D37505229

Aug 01 '22 20:08 facebook-github-bot