opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard
Published 3 months ago • verified publisher icon open-compass

[Feature] How about add bfcl evaluation to the repo

Open lebronjamesking opened this issue 10 months ago • 2 comments

描述该功能

So far, I don't think opencompass has bfcl already. I was wondering if it can be added in future

是否希望自己实现该功能？

  • [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

lebronjamesking avatar Mar 28 '25 08:03 lebronjamesking

As a hint, look up something like https://github.com/ShishirPatil/gorilla/blob/main/berkeley-function-call-leaderboard/README.md

lebronjamesking avatar Mar 28 '25 08:03 lebronjamesking

As a hint, look up something like https://github.com/ShishirPatil/gorilla/blob/main/berkeley-function-call-leaderboard/README.md

We consider adding the evaluation of agent capabilities later, such as function call. You are welcome to contribute at that time.

Zhudongsheng75 avatar Mar 28 '25 08:03 Zhudongsheng75