Mark Gorenstein

Results 3 comments of Mark Gorenstein

Downgrading transformers fixed this for me, `pip install --upgrade transformers==4.33`

Hi @brandonrobertz thanks for this suggestion! I've modified my issue to be a bit clearer - basically I'd want to bias or constrain beam search so that the 'bad words'...

Thanks @abetlen, LogitsProcessor is the approach I ended up taking. Have a partially working solution that I set aside, will report back when it's further along.