marcusm117

Fix Mistakes in the Dataset

2

Dear HumanEval Maintainers, Thank you so much for sharing this awesome Test Set! I fully understand that due to the nature of a Test Set, we want to keep it...

HumanEval/75 & HumanEval/116 Prompt-Solution-Test Alignment

6

Dear EvalPlus team, Thanks for fixing the bug in this task! I have noticed this issue (https://huggingface.co/datasets/openai_humaneval/discussions/2) for a while and it seems to me the actual problem is that...