Yuanchen comments

Repositories
Issues
Comments

Results 1 comments of


                                            Yuanchen

[BUG]: WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 73958 closing signal SIGTERM

Maybe you should check which dataset obj has been created. In train_sft.py, If using `SupervisedDataset` (line 106), it will finally has the 'attention_mask' key. Check `DataCollatorForSupervisedDataset` for more detail. ```...