DoffeDoffe

fix mask_user_labels

3

Dear authors of Starcoder, while using the framework, I noticed that mask_user_labels sometimes does not function properly. Upon investigation, I found that there might be an issue with the function...

some concern in "mask_user_labels"?

1

1. file chat/dialogues.py:239 should while labels[current_idx] != assistant_token_id and current_idx < len(labels): be while current_idx < len(labels) and labels[current_idx] != assistant_token_id: ? 2. chat/train.py:204 should mask_user_labels(tokenizer, dialogue_template, labels) be: for...