Léon

Bug rep when run gpipe with lm.one_billion_wds.OneBWdsGPipeTransformerWPM

16

Hi, when I try to run the Gpipe example _**one_billion_wds**_ using the given command: `trainer --run_locally=gpu --mode=sync --model=lm.one_billion_wds.OneBWdsGPipeTransformerWPM --logdir=/tmp/lm/log --logtostderr --worker_split_size=4 --worker_gpus=4` There is an error : Traceback (most recent...

@bignamehyp Hi, when I try to run the Gpipe example one_billion_wds using the given command: trainer --run_locally=gpu --mode=sync --model=lm.one_billion_wds.OneBWdsGPipeTransformerWPM --logdir=/tmp/lm/log --logtostderr --worker_split_size=4 --worker_gpus=4 There is an error : Traceback (most...