Aviv Brokman comments

Repositories
Issues
Comments

Results 4 comments of


                                            Aviv Brokman

[BUG] When using the chatglm model and training with deepspeed, I encountered an error in compiling cpu_adam.

@tjruwase It doesn't work for me.

[BUG] When using the chatglm model and training with deepspeed, I encountered an error in compiling cpu_adam.

@tjruwase It worked! But if it works, why bother ever coding `cpu_adam` in the first place?

ImportError `undefined symbol` of `fused_layer_norm_cuda`

I'm having this issue too.

ImportError `undefined symbol` of `fused_layer_norm_cuda`

@XiaohanZhangCMU I got the bug when I was using a Singularity (now Apptainer) container with CUDA 11.7 and pytorch compiled for CUDA 11.7 while using my University's cluster that has...