Scott Stancil
Scott Stancil
PR #540 improved our notification flow by only sending pings on the final failure of a test, after retry. But the Slack channel is still pretty crowded with all the...
For the last few days we've had sporadic failures with the invite tests, claiming that the invitation link was already used. It needs investigation. https://circleci.com/gh/Automattic/wp-e2e-tests/12872
Since moving to parallel test runs via Magellan in #504, the SKIP_TEST_REGEX envvar no longer functions to dynamically skip certain tests due to the way Magellan loads the spec files....
With all of the different 'wrapper repos' used to run the different sets of e2e tests (canary / visdiff / i18n / etc), we have separate copies of the NODE_CONFIG...
Investigate a way to check the difference between the signup/invite e-mail not being there (indicating an test failure) and nothing being there (indicating a Mailosaur outage). I'm not sure offhand...
Skipping the "Upgrade Contributor -> Author" test - https://github.com/Automattic/wp-calypso/issues/15456
Currently the canary tests that run against dserve don't have any way to detect when an image fails to build, so they need to wait for the full 10-minute timeout...