LUMO666
Results
1
comments of
LUMO666
> Did you use vLLM 0.7+? It seems that the recent versions of vLLM are the cause of memory leak. You can try vllm 0.6.3 same issue on 32B with...