Jack Freeman

icon indicating an email [email protected]

icon company The Morgridge Institute for Research icon location Madison, WI icon location Computational biologist interested in predictive diagnostic tools.

Results 2 issues of Jack Freeman

Missing mmlu as valid_dataset even though readme encourages download

1 comment

(gpt5) [jfreeman@mir-81 promptbase]$ python -m promptbase mmlu usage: __main__.py [-h] [--subject SUBJECT] [--list_subjects] {gsm8k,humaneval,math,drop,bigbench} __main__.py: error: argument dataset: invalid choice: 'mmlu' (choose from 'gsm8k', 'humaneval', 'math', 'drop', 'bigbench') Head of...

Issue #222 - YAML support

1. Compare experiments with visualize.py 2. YAML file path assignment