verifiers

verifiers copied to clipboard

Everything was doing great on training, for at least 90 steps, and then this error appeared, any idea on how I can prevent complete failure when theres connection issues? This...

Jgmedina95

willccbb

Fm/stg 868 browserbase mcp verifiers poc

1

## Description ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ]...

filip-michalsky

## Description ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ]...

cdreetz

## Description When running `vf-eval sentence-repeater -n 1 -r 1`, I get the error > ... > File ".../verifiers/environments/sentence_repeater/sentence_repeater.py", line 88, in env_response > "content": state["info"]["questions"][state["turn"]], > ~~~~~^^^^^^^^ > File...

anakin87

## Description ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ]...

willccbb

Added functionality in vf-eval to include or exclude specific IDs from dataset

1

## Description Added two parameters `include_ids` and `exclude_ids` to select which ids to include from the dataset and which ids to exclude from the dataset respectively. Fixes #581 ## Type...

ParamThakkar123

## Description ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking...

kcoopermiller

PRIME-RL Dev Branch

1

## Description Should not be merged. ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds...

mikasenghaas

Disentangle scaffold and dataset

1

@daniel can add some color here as well, but the gist of it is not clear how to handle scaffolds/ datasets, e.g. for SWE environments we have * scaffolds: mini...

mikasenghaas