Eric Xu

Results 4 comments of Eric Xu

That's very interesting. This plus the PR I just merged made me think that a more proper fix for this kind of problem is to wrap a Python class around...

Nice. Let me take a closer look. Definitely in love with this patch/PR!!!

Hey @nanthony21 , my apologies for not getting back right after the PR. I think you are right that `apply_new` is not used anywhere. It could be an artifact of...

Thanks for putting this together @lapp0 . I managed to integrate it with the rest of the vllm and got legit outputs! A minor change I made was that the...