harshal-pr
Results
1
comments of
harshal-pr
+1 **Llama 3.1 needs 0.5.3** https://github.com/vllm-project/vllm/releases/tag/v0.5.3 Can we upgrade this worker to support this out of box in runpod serverless vllm ?