AgentTuning icon indicating copy to clipboard operation
AgentTuning copied to clipboard

Can I run AgentInstruct data on the AgentBench?

Open harshraj172 opened this issue 2 years ago • 1 comments

Hey, thank you for your great work. I just wanted to know how can I run evaluation on the open source AgentInstruct data on the AgentBench repo. I will be really grateful if you can share the files defined here for running AgentInstruct on AgentBench. I am asking this because I want to see eval some models on the AgentInstruct data.

harshraj172 avatar Dec 29 '23 12:12 harshraj172

Thank you for reaching out with your query.

  1. AgentInstruct is a curated dataset used to fine-tune the model; if you need to evaluate the model, you can refer to AgentLM, which is fine-tuned with this data, or you can choose the model fine-tuned by yourself.
  2. For the latest evaluation code, please visit AgentBench. You can configure the fine-tuned model for evaluation in the ./configs directory. If you have any more questions or need additional help, please don't hesitate to ask.

lr-tsinghua11 avatar Jan 01 '24 06:01 lr-tsinghua11