Awesome work!

[Hellisotherpeople]

I will be playing with this, as I have a vested interest in seeing proper constraints implemented in LLMs which solve the issues that you outline with the technique I was using (namely, that filter-assisted decoding is greedy).

Super cool to see a bunch of MIT researchers citing my work, I'm honored!