VisualGLM-6B icon indicating copy to clipboard operation
VisualGLM-6B copied to clipboard

AttributeError: 'ChatGLMTokenizer' object has no attribute 'sp_tokenizer'. Did you mean: '_tokenize'?

Open MetaDreamer3d opened this issue 2 years ago • 3 comments

image image hi , can you help me?

MetaDreamer3d avatar Nov 29 '23 08:11 MetaDreamer3d

try pip install transformers==4.33.0

KinokoY avatar Nov 29 '23 11:11 KinokoY

meet the same problem. How to fix it ?try pip install transformers==4.33.0 can not solve it

floatingwh avatar Apr 12 '24 10:04 floatingwh

moving line "self.sp_tokenizer = SPTokenizer(vocab_file, num_image_tokens=num_image_tokens) " before "super().init(" at "init" of class ChatGLMTokenizer can solve this issue.

fengpeiyuan avatar May 14 '24 02:05 fengpeiyuan