Ian Webster

@sudarshanbadireddi Thanks for flagging. https://github.com/promptfoo/promptfoo/pull/3525 should fix and will be in next release.

Hmm, it's using your OpenAI API key to try to access a standard model, `gpt-4o-2024-05-13` ([OpenAI docs](https://platform.openai.com/docs/models/gpt-4o)). Is it possible that your OpenAI organization does not have access to this...

The reason should be visible in the Details (magnifying glass) view. Do you mean that you want to see it shown in the eval table itself?

I don't think we display this anywhere, but in theory we have the timing of every test case so could add it up. If you want an informal timer I...

Hi @strentom, definitely a bug. Just clarifying, are you running into this error with a redteam config? Based on the logs, you are hitting a redteam codepath which is different...

Got it, this is helpful thanks. #1877 should fix the immediate issue. There is another issue of your redteam config being picked up when it shouldn't.

Set *isReasoningModel: true* in the config for each provider https://www.promptfoo.dev/docs/providers/azure/#configuration-1 :) On Tue, Apr 22, 2025 at 8:07 AM mariana-pineda ***@***.***> wrote: > When I use the azure:chat:o1-mini model with...

Cool!! On Sun, Sep 7, 2025, 12:27 AM use-tusk[bot] ***@***.***> wrote: > *use-tusk[bot]* left a comment (promptfoo/promptfoo#5497) > > ❌ Generated 5 tests - 3 passed, 2 failed (a0c695f >...