cc360

Results 1 comments of


                                            cc360

There are 39000 words in my vocab.txt, but the model vocab_size is set to 50000. In this case, how does the embedded weight of 50000 * 768 output correspond to my 39000 words, is simply the first 39000? thanks

By the way, does the order of the output words' embedding correspond to the order of words in vocab.txt? thanks