utils/tokenization.py - "unicode" is not defined

[afurkank]

Hi,

I was trying to use the "tokenization.py" file to prepare data for my model. However, the "unicode" variable used in the "tokenization.py" file is not defined.

Here is the link to the one of the lines where "unicode" is used.

Any help is appreciated.

Thanks