czyysx

Sorry for my late reply. FYI, Here is my command to run on local GPUs: `~/lingvo/bazel-bin/lingvo/trainer --run_locally=gpu --mode=sync --model=lm.one_billion_wds.OneBWdsGPipeTransformerWPM --logdir=/tmp/lm/log --logtostderr --worker_split_size=2 --worker_gpus=2 --batch_size=8 --micro_num=4` And I downloaded the dataset...