Raviteja1996

Regrading Gpipe

7

Hi, I want to test how Gpipe works, when i searched in the web I found about lingvo repository. Can i know how to run it. I mean i didn't...

Could NOT find Protobuf (missing: Protobuf_PROTOC_EXECUTABLE)

14

Hi, when I am doing cmake in the build directory of lbann, initially I got protobuf-config.cmake not found error. So I gave a path of the protobuf-config.cmake file to Protobuf_DIR...

I have made changes to the mnist.py in the examples section, as documented in the GitHub I have made the changes to achieve data parallelism and model parallelism. I have...

mesh_shape = [("processor_rows", 2), ("processor_cols", 2)] layout_rules = [("batch", "processor_rows"), ("hidden", "processor_cols")] The above code change is mentioned to be using both model and data parallelism. But we will get...

I am trying to run the transformer model with Tensor2tensor using mesh-tensorflow (GPU-implementation) but I am facing few errors. **steps to reproduce:** PROBLEM=translate_enfr_wmt32k MODEL=mtf_transformer HPARAMS=mtf_transformer_paper_tr_0_mesh_8 DATA_DIR=$HOME/t2t_data TMP_DIR=/tmp/t2t_datagen TRAIN_DIR=$HOME/t2t_train/$PROBLEM/$MODEL-$HPARAMS mkdir -p...