Rajesh Shashi Kumar
Rajesh Shashi Kumar
This is likely happening because scons might be using python3 default. You can confirm this by checking the first line of /usr/bin/scons reading ```#! /usr/bin/python3``` Try using ```python2 `which scons`...
@demonicworm I had the same issue. It appears to be a problem with tracking the last import date. Can you try removing the "filter" part on the following line of...
@ziqipang did you figure out what was the issue here?
I was able to build a working vLLM 0.8.1 [image](https://hub.docker.com/r/rajesh550/gh200-vllm) based on the LambdaLabs Dockerfile as well. I was further able to include LMCache for CPU offloading support on the...
vLLM 0.9.0.1 with latest LMCache 0.3.0 integrated for GH200 `docker pull rajesh550/gh200-vllm:0.9.0.1` Dockerfile: https://github.com/rajesh-s/containers-for-gh200/blob/main/vllm/Dockerfile