verifiers icon indicating copy to clipboard operation
verifiers copied to clipboard

Added functionality in vf-eval to include or exclude specific IDs from dataset

Open ParamThakkar123 opened this issue 2 months ago • 1 comments

Description

Added two parameters include_ids and exclude_ids to select which ids to include from the dataset and which ids to exclude from the dataset respectively.

Fixes #581

Type of Change

  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [X] New feature (non-breaking change which adds functionality)
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] Documentation update
  • [ ] Test improvement

Testing

  • [X] All existing tests pass when running uv run pytest locally.
  • [X] New tests have been added to cover the changes

Checklist

  • [X] My code follows the style guidelines of this project as outlined in AGENTS.md
  • [X] I have performed a self-review of my own code
  • [X] I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [X] My changes generate no new warnings
  • [ ] Any dependent changes have been merged and published

Additional Notes

ParamThakkar123 avatar Nov 28 '25 04:11 ParamThakkar123

@ParamThakkar123 this doesn't seem like it's doing any actual filtering at the dataset level, just adding fields?

willccbb avatar Dec 01 '25 04:12 willccbb