Anonymous-AI1 issues

Repositories
Issues
Comments

Results 1 issues of


                                            Anonymous-AI1

关于多卡训练sup-bert的疑问

Hi~ 感谢你们的开源工作 #32 中已经指出对于 PyTorch 2+，应该修改 `run.sh` 中的脚本，由 `python -m torch.distributed.launch` => `torchrun` ```.sh "sup-bert") # BC=(python -m torch.distributed.launch --nproc_per_node 4 train.py) BC=(torchrun --nproc_per_node 4 train.py) TRAIN_FILE=data/nli_for_simcse.csv BATCH=128 EPOCH=3 LR=5e-5...