RuntimeError: attn_softmax_inplace_forward_ not implemented on CPU

[JeongSooNa]

What is thus Issue?

RuntimeError: attn_softmax_inplace_forward_ not implemented on CPU

[ramithuh]

If you are using CUDA through a conda install like (conda install nvidia/label/cuda-11.3.1::cuda), you might need to have these env variables set , so that it correctly points to the environement's CUDA directories.

export CUDA_HOME=$CONDA_PREFIX
export CUDA_PATH=$CONDA_PREFIX
export LIBRARY_PATH=$CONDA_PREFIX/lib:$LIBRARY_PATH
export LD_LIBRARY_PATH=$CONDA_PREFIX/lib:$LD_LIBRARY_PATH

[EvaniLach]

Have you managed to solve this issue?