VisualGLM-6B icon indicating copy to clipboard operation
VisualGLM-6B copied to clipboard

加载微调后模型出错

Open DeerEyre opened this issue 2 years ago • 0 comments

model, args = FineTuneVisualGLMModel.from_pretrained('/mnt/dolphinfs/hdd_pool/docker/user/hadoop-search/ganshu01/projects/VisualGLM-6B-main/output/finetune-visualglm-6b-06-20-14-50', args=argparse.Namespace( fp16=True, skip_init=True, use_gpu_initialization=False, device='cpu', ))

ValueError: Missing keys for inference: ['transformer.layers.0.attention.dense.matrix_A', 

'transformer.layers.0.attention.dense.matrix_B', 'transformer.layers.14.attention.dense.matrix_A', 'transformer.layers.14.attention.dense.matrix_B']. If you still want to inference anyway, pass --force_inference to args.

DeerEyre avatar Jun 20 '23 11:06 DeerEyre