tnt icon indicating copy to clipboard operation
tnt copied to clipboard
verified publisher icon pytorch

Improve testing for composable FSDP

Open rohan-varma opened this issue 2 years ago • 0 comments

🚀 The feature

Should add some tests to ensure the right sharded grad scaler, no_sync ctx manager, etc is picked out when using composable FSDP

Motivation, pitch

.

Alternatives

No response

Additional context

No response

rohan-varma avatar Mar 27 '23 21:03 rohan-varma