DiffCSE icon indicating copy to clipboard operation
DiffCSE copied to clipboard
verified publisher icon voidism

Index out of range in self

Open Old-Lan opened this issue 2 years ago • 0 comments

The vocab size of the sentence encoder is 50256, but the vocab size of the generator is 30522. This will cause the index out of range. The code is follow: cls.generator(mlm_input_ids, attention_mask) mlm_input_ids.min()=0 mlm_input_ids.max()=50264 How should I initialize them so that they can be consistent?

Old-Lan avatar Jul 12 '23 08:07 Old-Lan