Loading CFGs from EBNF files

[shermansiu]

Is there a way to do constrained decoding with grammars loaded from EBNF files? e.g. From https://github.com/Saibo-creator/transformers-CFG/blob/main/examples/grammars/json.ebnf

I'd rather not have to manually re-write EBNF files to use guidance's grammar API every time I need to use a new grammar.

Ideally, I'd like to be able to use the constrained decoding from here: https://github.com/Saibo-creator/transformers-CFG/tree/main and guidance together, but it doesn't look possible.

[Saibo-creator]

Hey @shermansiu

I'm the person behind transformers-CFG, and I'm really into the idea of bridging these two to work together more smoothly. It's a great suggestion and something that could seriously boost usability.

However, given my current bandwidth, it might not happen super quickly. I'm committed to looking into it, but just wanted to set the expectation that it could take some time.

I'll keep you in the loop.