SB

@shruti-bh What parameters for model-overrides with configuration 12b_last_chk_2_gpus?

 https://fairseq.readthedocs.io/en/latest/command_line_tools.html Tried the following as model-overrides for configuration 12b_last_chk_2_gpus: --model-overrides '{"ddp_backend": "c10d", "pipeline_balance": "29, 22, 1" , "pipeline_devices": "0, 1, 0" }' Process gets killed. No Luck Yet.