How do I launch the api on a graphics card other than cuda: 0

[Stark-zheng]

1、deepspeed --include localhost:4 api.py

2、CUDA_VISIBLE_DEVICES=4 python api.py

Neither method can specify cuda to use, so cuda: 0 is used by default

How do I set it?

[zhjunqin]

same question, CUDA_VISIBLE_DEVICES not working