BrowserGym icon indicating copy to clipboard operation
BrowserGym copied to clipboard

PR Template for benchmark creation

Open TLSDC opened this issue 8 months ago • 0 comments

Benchmark tutorial

This PR serves as a template for benchmark creation. It involves the following steps:

  • [ ] Creating a task object to integrate your tasks to BrowserGym
  • [ ] Registering said tasks to expose them through the gym.make interface. (see loop.py )
  • [ ] Make your benchmark pip installable along with browsergym
  • [ ] Define an action set for your benchmark
  • [ ] Define a Benchmark object to use your benchmark in the AgentLab experiment setting
  • [ ] Add basic Tests (see existing tests for inspiration)
  • [ ] Update ReadMe

TLSDC avatar Apr 29 '25 15:04 TLSDC