Will

Clicking anywhere on the range auto sets the `max-slider-handle` to the maximum value; This should not happen. `Step` is set to `0.5` and `ticks_snap_bounds` is set to `0`, so I'm...

Running on Google Colab

6

Hello - I am excited to try out your library on a Google Colaboratory Notebook. However, I am running into difficultly setting it up, having tried both the Linux and...

Adds delete friend route

2

- [x] Complete todos - [ ] Remove changes from my markdown auto-formatter

### Summary This PR migrates the site architecture from [Create React App](https://create-react-app.dev/) to [Next.js](https://nextjs.org/). It implements several _opinionated_ best-practices, such as Typescript and React Server Components. ### Motivation - Next.js...

feat: Exfiltration redteam plugin

2

## Summary This PR adds a redteam plugin that generates tests to validate whether an AI can be exfiltrated to reveal internal information such as its system prompt, details about...

refactor: Dockerize API

1

## Summary This PR adds a docker image for the API. ## Motivation As Ian correctly noted, my deprecation of the Next.js native-API in #999 will break the self-hosted web...

## Summary This PR upgrades promptfoo from Next.js version `13.4.13` to `14.2.4`. ## Motivation Whenever somebody `npm install`s promptfoo, they are warned of critical security vulnerabilities related to Next 13....

This PR allows extension hooks – `beforeAll`, `beforeEach`, `afterEach` and `afterAll` to modify and return their respective `context` arguments and have this updated context persisted downstream.

chore(eval): Pass data returned from `beforeAll` and `beforeEach` hooks to `provider.callApi`

2

## Overview - Addresses #4080 which is a reasonable expectation. - Data returned by either `beforeAll` or `beforeEach` will get passed in to `provider.callApi` as `context.extensionHookOutputs.beforeAll` and `context.extensionHookOutputs.beforeEach` respectively. ##...

[FEAT] Specify logger within SettingsCreator

1

### Is your proposal related to a problem? More ergonomics than problem. ### Describe the solution you'd like `SettingsCreator` to support a `logger` argument with the signature: ```py logger: logging.Logger...