ChristineSeven
Results
2
issues of
ChristineSeven
In my case , I deployed the vllm service on 2 GPUs A800. but when I doing mutiple requests, I meet the ray OOM error. Could you please help check...