chensimian

icon indicating a website link My Blog： https://www.smian.com.cn

Results 4 comments of chensimian

No module named 'colossalai.kernel.op_builder'

my environment is ： Cuda compilation tools, release 11.7, V11.7.64 and python -c "import torch; print(torch.version.cuda)" 11.7

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

> Hi, Please install apex from https://github.com/NVIDIA/apex, or set enable_fused_normlization to False. I have installed it, but it is not working.

[BUG]: No module named 'colossalai.kernel.op_builder'

> 请使用 cuda 扩展构建 Colossalai，然后重试。相关详细信息请参阅此[文件。](https://github.com/hpcaitech/ColossalAI/blob/main/docker/Dockerfile) your answers are not helpful.

奖励模型断点续训报错

我也遇到了该问题，在训练结束保存时报错，RuntimeError: Error(s) in loading state_dict for AutoModelForCausalLMWithValueHead: