lighteval
lighteval copied to clipboard
Add a logger in the metric functions
It is currently cumbersome to log details of what is happening in metric functions, log judge prompt in llm as judge metric for example. Passing it the evaluation tracker would greatly simply this.