motaatmo

I am having a similar problem. Example code: ``` >>> import guidance >>> import re >>> json_string_regex = "\"([^\"\\\\]|\\\\.)*\"" >>> re.match(json_string_regex, '"ddd"') >>> mock = guidance.models.Mock() >>> mock + guidance.regex(json_string_regex)...

As I don't really need a dataclass as a return value (as long as the results are parsed correctly), I tried a different way to query lmql, which also fails...

Hi, I did. I'm using Mistral 7B, and upon start, both used GPUs (A100 each) fill their VRAM up to until half (which seems already too much given the model...

I will do so! Unfortunately, right now there is a queue on the SLURM node I've got to use, therefore it might take some time. Just to be sure to...

I called the script using standard python (non-interactive, from the command line) Hudson Cooper ***@***.***> schrieb am Mo., 16. Sept. 2024, 21:18: > Hey @motaatmo thanks for the issue. What...

Works perfectly, thank you! On Mon, Sep 16, 2024 at 9:54 PM Hudson Cooper ***@***.***> wrote: > Got it. By default, models are quite verbose (and the experience is >...