ASAM icon indicating copy to clipboard operation
ASAM copied to clipboard
verified publisher icon SamsungLabs

Multi-GPU training

Open shuo-ouyang opened this issue 4 years ago • 0 comments

Hi, thanks for your open-source implementation of ASAM. I am wondering whether if ASAM support multi-GPU training, and how to calculate grad norm when using multiple GPUs? Thanks again and looking forward to your reply.

shuo-ouyang avatar Aug 10 '21 08:08 shuo-ouyang