adis98

Results 2 issues of adis98

Hi @jonathanasdf , @bignamehyp What is the default buffer size for cross device communication in GPipe? Is there a way to modify this?

Hi, I've been experimenting with GPipe and was wondering if it is possible to run different micro-batches on different GPUS? For example if there are 16 micro-batches, is it possible...