Shixin Jiang

ValueError: Tokenizer class InternLM2Tokenizer does not exist or is not currently imported.

3

# error information ``` Traceback (most recent call last): File "/home/sxjiang/project/InternVL/test_chat.py", line 13, in tokenizer = AutoTokenizer.from_pretrained(path) File "/home/sxjiang/miniconda3/envs/internvl/lib/python3.9/site-packages/transformers/models/auto/tokenization_auto.py", line 784, in from_pretrained raise ValueError( ValueError: Tokenizer class InternLM2Tokenizer does...