石大大 comments

Repositories
Issues
Comments

Results 2 comments of


                                            石大大

Cupy error while training (`CUDARuntimeError: cudaErrorInvalidDevice: invalid device ordinal`)

``` # vi training/finetune_GPT-NeoXT-Chat-Base-20B.sh (trap 'kill 0' SIGINT; \ python ${DIR}/dist_clm_train.py $(echo ${ARGS}) --cuda-id 0 --rank 0 \ & \ # python ${DIR}/dist_clm_train.py $(echo ${ARGS}) --cuda-id 1 --rank 1 \...

I am having this issue

pip install --upgrade transformers==4.29.0