agent icon indicating copy to clipboard operation
agent copied to clipboard

Structured outputs

Open CodingDive opened this issue 1 year ago • 2 comments

Hello! 👋 Thank you so much for all the work on this library ❤️

Is it possible to support structured outputs based on the zod schema? https://openai.com/index/introducing-structured-outputs-in-the-api/

Right now, I'm wasting a lot of tokens trying to get the models to follow the schema, while still receiving the following error every now and then.

There seems to be a validation going on of the schema, but it just throws if it doesn't match. I'm using gpt-4o.

Error in processing: {
  type: 'xstate.error.actor.0.agent.processing',
  error: InvalidToolArgumentsError [AI_InvalidToolArgumentsError]: Invalid arguments for tool agent_prompt: Type validation failed

CodingDive avatar Sep 16 '24 17:09 CodingDive

Yes, great idea. I'm actually working on simplifying the API (see #51) and you will be able to use generateObject directly.

Does this happen for you during agent.decide(…)?

davidkpiano avatar Sep 16 '24 17:09 davidkpiano

Does this happen for you during agent.decide(…)?

Yes!

That's some great news! 🥳

CodingDive avatar Sep 16 '24 18:09 CodingDive