Peng Wei
Peng Wei
Hi team, Here is the PR of adding the llm metrics with application to our current model monitoring framework. Here is the high level design [data flow](https://github.com/iguazio/dev-docs/blob/development/Model-Monitoring/monitoring_app.md). **What has been...
Hi @guy1992l, @yonishelach, @ZeevRispler Here is the PR to add both evaluate metrics and llm-as-a-judge metrics. - The evaluate metrics needs both prediction and reference to compute the scores. -...
Hi @guy1992l @ZeevRispler @yonishelach I have followed your work of auto_trainer to implement the dpo trainer. Please review and let me know. Thanks
Hi @juanmc2005 , This PR is solving the error of complaining torch doesn't have subclass numpy issue. It's just detaching the torch before call numpy(). Please review and let me...