DeerEyre

RuntimeError: mat1 and mat2 shapes cannot be multiplied (1280x1024 and 768x4096)

1

I got this problem when I follow your restruction to run finetune_visualglm.py who know how to solve this problem? **[2023-06-16 17:34:52,083] [INFO] [RANK 0] do_test ...................... False [2023-06-16 17:34:52,083] [INFO]...

model, args = FineTuneVisualGLMModel.from_pretrained('/mnt/dolphinfs/hdd_pool/docker/user/hadoop-search/ganshu01/projects/VisualGLM-6B-main/output/finetune-visualglm-6b-06-20-14-50', args=argparse.Namespace( fp16=True, skip_init=True, use_gpu_initialization=False, device='cpu', )) ValueError: Missing keys for inference: ['transformer.layers.0.attention.dense.matrix_A', 'transformer.layers.0.attention.dense.matrix_B', 'transformer.layers.14.attention.dense.matrix_A', 'transformer.layers.14.attention.dense.matrix_B']. If you still want to inference anyway, pass --force_inference to args.