Loi Nguyen comments

Results 2 comments of


                                            Loi Nguyen

if i use 2 GUPs instead of 3, What should the batch size and lr be adjusted to fit ? I am trying with 2 V100.

@SuperMHP > If your GPU cannot support 32 bsize, you can: > > 1. Set the bsize as big as possible. > 2. A trick may work but I cannot...