Zixu Zhao
Results
1
comments of
Zixu Zhao
> In `bigcodebench/provider/openai.py`, all model processes prompts sequentially, the func `_codegen_batch_via_concurrency` process each prompt n time in parallel, but still sequentially process the whole prompts. > > Looks wired, and...