lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard

Fixes #1023: add custom processing logic for MetricGrouping

Open colinzuo opened this issue 3 months ago • 2 comments

add another level of loop to dict fields in MetricGrouping instance

colinzuo avatar Oct 22 '25 01:10 colinzuo

In LightevalTaskConfig:str, asdict(self) changed MetricGrouping to dict, so

adding an str method to the MetricGrouping

won't work To stay consistent with the existing code, I added another level of loop for MetricGrouping, with no other changes

colinzuo avatar Oct 22 '25 01:10 colinzuo

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.