thecheekygeek

Compatibility with future python versions

2

Hi, this is a really cool peice of work! I was wondering if this was compatible with pytorch 2.3.0? And if not, if there was any way to make it...

### System Info - ### Who can help? @ncomly-nvidia https://arxiv.org/abs/2405.04437 This is currently a PR on vLLM as well. Can we also get it on here too, to support dynamic...