Eric Xu
Eric Xu
That's very interesting. This plus the PR I just merged made me think that a more proper fix for this kind of problem is to wrap a Python class around...
Nice. Let me take a closer look. Definitely in love with this patch/PR!!!
Hey @nanthony21 , my apologies for not getting back right after the PR. I think you are right that `apply_new` is not used anywhere. It could be an artifact of...
Thanks for putting this together @lapp0 . I managed to integrate it with the rest of the vllm and got legit outputs! A minor change I made was that the...