starcoder
starcoder copied to clipboard
Fix run finetune.py from torch.distributed.launch
To fix the unrecognized arguments problem, when running finetune.py from torch.distributed.launch.
the argument local_rank needs to be changed to local-rank.
launch command:
python -m torch.distributed.launch --nproc_per_node=2 finetune.py --model_path xxx ...
error log
finetune.py: error: unrecognized arguments: --local-rank=0