Jason

icon indicating an email [email protected]

icon company XSYS Technology icon location Computing to make the world better.

Results 1 comments of Jason

How to Suppress "Using bos_token, but it is not set yet..." in HuggingFace T5 Tokenizer

Hi @Narsil , I'm using transformers 4.16.2. Thank you for the tip regarding T5TokenizerFast. I was able to mitigate the issue by explicitly adding special tokens, like so: ``` tokenizer.add_tokens([f"_{n}"...