BenjaminMarechalEVITECH

openai API `n` argument is ignored

1

# Prerequisites Please answer the following questions for yourself before submitting an issue. - [X] I am running the latest code. Development is very rapid so there are no tagged...

Provide logprobs in the API.

3

Hi, Is there any way to get probabilities of tokens from moondream models ? In OpenAI API, this is called "logprobs" (https://platform.openai.com/docs/api-reference/chat/create) If not, that would be a be a...