Daniel Melcer
Daniel Melcer
Occasionally, students will leave the drafting window open and step away from the computer. The application should have a (generous) timer that will automatically remove drafting questions from the queue...
### EvalPlus version v0_1_0_hf ### Output of running `ls ~/.cache/bigcodebench` BigCodeBench-v0.1.0_hf.jsonl ### Task ID of the programming task BigCodeBench/211, BigCodeBench/215, probably some others as well ### The original test ```python...
## Describe the bug When using SliceSampler, with `strict_length=False`, the documentation recommends the use of `split_trajectories`. However, if two samples from the same episode are placed next to each other,...
When creating a large number of jobs (for example- from calling `hap run` in a loop in a bash script), the number column doesn't expand past two digits:  `stty...