bluehost-wordpress-plugin icon indicating copy to clipboard operation
bluehost-wordpress-plugin copied to clipboard

update matrix workflow to only record if PR has a `debug` label added

Open circlecube opened this issue 2 years ago • 3 comments

Proposed changes

This will update our matrix tests to only record to cypress cloud if we have added a debug label to the PR. Happy to update it to anything else, but that felt simple enough without making a specific label for this one thing.

This should cut down a lot of our cloud usage (and charges) and still give us a simple way to trigger the matrix recording in cloud as needed.

Type of Change

  • [ ] Bugfix (non-breaking change which fixes an issue)
  • [ ] New feature (non-breaking change which adds functionality)
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] Documentation Update (if none of the other choices apply)

Checklist

  • [ ] I have read the CONTRIBUTING doc
  • [ ] Linting and tests pass locally with my changes
  • [ ] I have added tests that prove my fix is effective or that my feature works
  • [ ] I have added necessary documentation (if appropriate)

Further comments

circlecube avatar Dec 08 '23 16:12 circlecube

1 flaky test on run #5948 ↗︎

0 245 57 0 Flakiness 1

Details:

also run when label changes
Project: Bluehost Brand Plugin Commit: 41e9a7ded0
Status: Passed Duration: 14:59 💡
Started: Dec 8, 2023 8:28 PM Ended: Dec 8, 2023 8:43 PM
Flakiness  tests/cypress/integration/help.cy.js • 1 flaky test

View Output Video

Test Artifacts
Help Page > Is Accessible Test Replay Screenshots Video

Review all test suite changes for PR #857 ↗︎

cypress[bot] avatar Dec 08 '23 16:12 cypress[bot]

1 flaky test on run #5997 ↗︎

0 166 26 0 Flakiness 1

Details:

Merge 41e9a7ded0b1f8c5f81038db718e96eb0730df19 into 58edefef8d81fea53b2d0e5a2d46...
Project: Bluehost Brand Plugin Commit: 854af4a6c0 ℹ️
Status: Passed Duration: 09:01 💡
Started: Dec 11, 2023 10:15 PM Ended: Dec 11, 2023 10:24 PM
Flakiness  tests/cypress/integration/help.cy.js • 1 flaky test

View Output Video

Test Artifacts
Help Page > Is Accessible Test Replay Screenshots Video

Review all test suite changes for PR #857 ↗︎

cypress[bot] avatar Dec 08 '23 17:12 cypress[bot]

Only once we add the debug label to the PR, the cypress tests are run in cloud and recorded.

circlecube avatar Dec 11 '23 22:12 circlecube

Closing this as we'll move the workflows to another repo to be reusable and at that point will have inputs available for recording.

circlecube avatar May 31 '24 17:05 circlecube