Jasper Dekoninck
Jasper Dekoninck
I am not sure if that is the case, since when I run the query with the openai API the text parameter does not contain "when". However, the logprobs do...
You are right, the following also produces the mistake: ```python argmax """A list of good dad jokes. A indicates the punchline Q: How does a penguin build its house? A:...
Aah yes, I am using `lmql.run,` forgot that the problem cannot be really fixed there. Maybe something to add to the documentation?
A similar issue happens with the following constraint: ```python argmax(chatty_openai=True, max_len=20) """[A]""" from 'openai/text-davinci-003' where len(TOKENS(A)) > 5 ```
Unfortunately, I will need some more info to debug your issue. Did you follow the instructions and run `python -m pip install -e .` in the appropriate folder? Can you...
Unfortunately, closed-source large language models generally do not provide any logprobs in their predictions. ChatGPT, Claude, Mistral-Large, ... do not provide these logprobs and can therefore not use the technique...
Hi, This bug should now be fixed, apologies for that. Note that for reproducing our results, we advice to use the "v1.0" branch, where this bug should not occur.
Hi! Unfortunately, Model Arithmetic requires access to the logits of models and can therefore not be used in a fully black-box setting. While some APIs do support sending logits of...
I am not sure exactly what you mean when you refer to "p2". Could you clarify the question?
No worries, it's an interesting topic, so you are not going to be disappointed :)