Denis Sushentsev

icon indicating an email [email protected]

icon company @JetBrains icon location St. Petersburg, Russia icon location BSc in SPBU, MSc in HSE, ML in JetBrains

Results 2 comments of Denis Sushentsev

Teacher forcing per timestep?

> Hi, > > I don't understand why the teacher forcing is being done per the whole sequence. The definition of the teacher forcing claims that at each timestep, a...

LlamaTokenizer has no `pad` token, leading to failure during batch-tokenization

> Note that the EOS token returned by `tokenizer.eos_token` is wrong in any case (this is a known issue and @ArthurZucker should fix this). The EOS token is not `""`...