kaibush comments

Repositories
Issues
Comments

Results 1 comments of


                                            kaibush

Using sat framework inference mathglm-10B to report an error

> load模型的时候加一个参数，build_only=True，可以解决你提到的这个问题 model, args = CachedAutoregressiveModel.from_pretrained(model_path,args,build_only=True) > > 但是又会出现新的问题 > > ^@[2023-10-03 09:08:14,117] [INFO] [RANK 0] Cannot find THUDM/chatglm2-6b from Huggingface or sat. Creating a fake tokenizer... Traceback (most recent...