OpenAI
OpenAI copied to clipboard
Make response props parsing more robust for OpenAI compatible APIs
I noticed that local open-ai compatible response would fail parsing oftentimes with some fields missing; Made toolChoice and the token metrics optional to satisfy.
I can see how it might be a breaking change for some consumers but unsure if it's better to provide a default value (might also break assumptions)