alg_con
alg_con
@shibing624 您好,运行报ImportError: This modeling file requires the following packages that were not found in your environment: configuration_chatglm. Run `pip install configuration_chatglm`这个错是什么原因呢?
请问代码修改了哪里才解决这个问题的
@QZH-eng I also encountered this OOM (Out of Memory) issue in L40s.
@QZH-eng I encountered OOM (Out of Memory) issue during inference, Specifically , when executing "engine_from_bytes(bytes_from_path(self.engine_path))" this step, an OOM (Out of Memory) error occurs.Can you share your code?
@lix19937 How to split the model for this issue?Could you provide relevant codes and resources?