CXH19940504 comments

Repositories
Issues
Comments

Results 1 comments of


                                            CXH19940504

使用多卡加载模型，推理时报错

> 我也在多卡推理的时候报错了，chatglm2报错，llama2好像没问题 > > /lightllm/lightllm/models/chatglm2/layer_infer/transformer_layer_infer.py:30: UserWarning: An output with one or more elements was resized since it had shape [6, 128], which does not match the required output shape [6,...