Brad Hilton
Brad Hilton
Sorry, this isn't supported. If you know what the object type is, like in this example, you could always use key paths: ``` let obj = Info() let xxx =...
@TofPlay All I have to do is make sure the SwiftKVC scheme is shared, right?
Any updated eta on when this may be merged? cc @ebsmothers @krammnic
I'm also seeing this issue, enabling prefix caching seems to cause issues when hitting `/completions` with `prompt_logprobs` I think, getting the same assert error.
@Lucas-Fernandes-Martins have you been able to test this? Does it work?
Thank you @Lucas-Fernandes-Martins for your investigation. I am afraid that adding Gemma 3 support will likely be tricky.
Thank you @Lucas-Fernandes-Martins for investigating!
I pushed something earlier today that may help address the hanging you're seeing. To get the latest version of `openpipe-art`: ``` uv add 'git+https://github.com/OpenPipe/ART.git#egg=openpipe-art[backend]' ```
Are you trying to run this on a B200? I'm not sure we support Blackwell yet.
Let me try reproducing.