motaatmo

Debugging grammars by example

2

Hi, is there a way to test a guidance grammar without using a LLM call? I'm trying to write a complex grammar, and it is very cumbersome to develop it...

Serve-model running out of memory with multiple GPUs

4

Hi, I'm trying to process large context sizes with lmql serve-model. Unfortunately, I'm running into "CUDA out of memory" issues. Using 1, 2, or 3 A100 did not make a...

Best way for structured output and few-shot optimization

1

Hi, I'm trying to extract some information from documents into a machine-readable format. One of the key points is that the result has to contain some lists that might have...

Lots of HTML output

8

**The bug** When calling guidance using an openai model (GPT4o-mini; I didn't try other models yet), lots of output are created, that clutter my own output. It looks HTMLish: ```...

additionalProperties in JSON schema

2

Hi, I'm trying to create a JSON schema that must contain the additionalProperties field. Is there a correct way to do so? Right now I'm adding it manually... Sincerely yours,...