stagehand icon indicating copy to clipboard operation
stagehand copied to clipboard

prompt: update instructions for browser automation

Open feder-cr opened this issue 1 year ago • 1 comments

  • enhance the system prompt with more detailed guidelines for Playwright usage
  • add sections on handling popups and missing fields, and tool usage specifics
  • improve clarity on variable handling and focus on executing targeted actions

why

many times models like the gpt-4o-mini fail to generate skipSection action, with this prrompt this almost never happens.

feder-cr avatar Dec 29 '24 20:12 feder-cr

⚠️ No Changeset found

Latest commit: 5c225f01f700e0552bcf04d10bad7b5b118d879c

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

changeset-bot[bot] avatar Dec 29 '24 20:12 changeset-bot[bot]

Hey @feder-cr, thanks for doing this! Do you have any examples of where this prompt performed better than the existing one? Would love to add to our eval set :)

kamath avatar Jan 02 '25 18:01 kamath

@kamath Tested with DeepSeek and GPT-Mini for application across various job search middleware, but this happens because, also for other kind of sites, less powerful models with the current prompt struggle to assess which sections to skip without having to copy anything.

feder-cr avatar Jan 03 '25 13:01 feder-cr

Thanks for taking the time to do this!! I think it should be addressed in #373 though; lmk if this doesn't address your needs :) happy to re-open if so

kamath avatar Jan 07 '25 04:01 kamath