starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

Fix run finetune.py from torch.distributed.launch

Open iohub opened this issue 2 years ago • 0 comments

To fix the unrecognized arguments problem, when running finetune.py from torch.distributed.launch. the argument local_rank needs to be changed to local-rank.

launch command:

python -m torch.distributed.launch --nproc_per_node=2 finetune.py --model_path xxx ...

error log

finetune.py: error: unrecognized arguments: --local-rank=0

iohub avatar Oct 31 '23 13:10 iohub