apex
apex copied to clipboard
Parallel wrappers should only be applied to the model(s) AFTER \n
RuntimeError: Incoming model is an instance of torch.nn.parallel.DataParallel. Parallel wrappers should only be applied to the model(s) AFTER the model(s) have been returned from amp.initialize.
How to solve it