ywb2018
ywb2018
请问下你跑的时候emb size设置的是768吗，其他代码有改动吗？我这边跑的rte，指标很低只有三四十不知为何
> 我排查到好像是这个原因  老哥牛啊，问题解决了
> > @chinoll I have a similar problem. Where do you exaclty add the .../bin/ninja path in the torch/utils/cpp_extension.py file? > >  it works for me, thx
> It looks like PyTorch's C++ extensions are configured with `CUDNN_HOME` or `CUDNN_PATH`: https://github.com/pytorch/pytorch/blob/5a80d2df844f9794b3b7ad91eddc7ba762760ad0/torch/utils/cpp_extension.py#L209 PyTorch's build is configured with `CUDNN_ROOT`: https://github.com/pytorch/pytorch/blob/5a80d2df844f9794b3b7ad91eddc7ba762760ad0/cmake/Modules_CUDA_fix/FindCUDNN.cmake#L4 so what i can do to handle this issue?...
> Hi, I came across the same problem when using ray==2.12.0, deepspeed==0.15.0. But when I upgraded them, the problem solved: `pip install deepspeed==0.16.3` `pip install ray[default]==2.42.0` thanks a lot, solve...