VisualGLM-6B
VisualGLM-6B copied to clipboard
AttributeError: 'ChatGLMTokenizer' object has no attribute 'sp_tokenizer'. Did you mean: '_tokenize'?
hi , can you help me?
try pip install transformers==4.33.0
meet the same problem. How to fix it ?try pip install transformers==4.33.0 can not solve it
moving line "self.sp_tokenizer = SPTokenizer(vocab_file, num_image_tokens=num_image_tokens) " before "super().init(" at "init" of class ChatGLMTokenizer can solve this issue.