opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

[Update] Enhancements and Fixes in Needlebench

Open Mor-Li opened this issue 9 months ago • 0 comments

  1. Optimized Needlebench Configurations

    • Streamlined the writing of Needlebench config files by eliminating redundant code and improving structure.
    • Reduced code duplication across multiple configuration files, making the setup more efficient and easier to manage.
  2. Updated Multi-Needle-Reasoning Task

    • Modified the Multi-Needle-Reasoning task to use ATC-specific needles, aligning the task with the ATC dataset requirements.
    • Adjusted the configuration settings to better suit the ATC dataset, ensuring accurate and relevant results.
  3. ATC Fixes

    • The default configuration for ATC has been changed to use a fill-in-the-blank format \boxed{}.
    • Additionally, the diversity of the tasks has been increased.

Mor-Li avatar Apr 25 '25 09:04 Mor-Li