Shengyang Sun

NVIDIA

Results 6 comments of


                                            Shengyang Sun

GPTSFTChatDataset loss_mask becomes all False when prompt length > max_seq_length

Yeah, this will also fix the problem.

GPTSFTChatDataset loss_mask becomes all False when prompt length > max_seq_length

This issue should keep active since the same problem has been encountered by others as well.

read system token from data in gpt_sft_chat_dataset

@yidong72 Shall we contact someone to conduct the CI?

read system token from data in gpt_sft_chat_dataset

@yidong72 can you review it again? I updated the `get_prompt_template_example` function.

read system token from data in gpt_sft_chat_dataset

> @yidong72 can you review it again? I updated the `get_prompt_template_example` function. gentle ping @yidong72

read system token from data in gpt_sft_chat_dataset

@yidong72 @ko3n1g Please take a look at it. Thanks!