Jan Backes
Jan Backes
Thanks for the comments - I store the "index config" now explicitly as part of the pickle via `ConfigParser`. Unfortunately one cannot get the used metric from the index itself...
@sushant-openai thx, added an updated yaml file!
Thanks for the comment @usama-openai. It was actually the initial idea to provide a list of valid moves for certain backgammon evals - where that is applicable. Eventually I decided...
Thanks for the comment - yes that makes total sense! I [rebuild the data](https://github.com/bakebrain/evals_backgammon/blob/main/generate_openai_eval_samples.ipynb) and adjusted the yaml file accordingly.
Added the notebook to `evals/registry/data/backgammon/`.