TTtianTT comments

Repositories
Issues
Comments

Results 3 comments of


                                            TTtianTT

内存利用率随着save_freq增长是为什么呀

I met the same bug

How to set parameters to solve OOM！！！

> cuda oom or cpu memory oom? I always met cpu memory oom

Ray OOM causes the process to be killed

> An example script to fix this problem: > > export VLLM_COMMIT=227578480d71fc94ef46ca77fb69496412158d68 > sudo pip install vllm --pre --extra-index-url https://wheels.vllm.ai/${VLLM_COMMIT} > git clone -b verl_v1 https://github.com/hiyouga/vllm.git > sudo cp -r...