coddinglxf

when training the masked LM, the unmasked words (have label 0) were trained together with masked words?

6

According to the code ``` def random_word(self, sentence): tokens = sentence.split() output_label = [] for i, token in enumerate(tokens): prob = random.random() if prob < 0.15: # 80% randomly change...