nodejs.org icon indicating copy to clipboard operation
nodejs.org copied to clipboard
verified publisher icon nodejs

Better playwright tests

Open flakey5 opened this issue 3 months ago • 2 comments

Enter your suggestions in details:

Tests should include tests of actual content re #8248 and https://openjs-foundation.slack.com/archives/CVAMEJ4UV/p1761008932326439?thread_ts=1761008123.880979&cid=CVAMEJ4UV

flakey5 avatar Oct 21 '25 01:10 flakey5

FWIW E2E currently covers:

  • That translations are working
  • That the theme is interchangeable
  • That search functionality works

Even so, I don't think E2E would have caught this, since a PR didn't introduce a regression, rather, data we didn't expect did. Tests will all sorts of malformed and unexpected data may help, though.

avivkeller avatar Oct 21 '25 20:10 avivkeller

Yeah the only way to detect would have been timed testing of the site on some cron, like every couple minutes. Not impossible, but a lot of work. I suspect there are tools and services that could do this.

At the time this issue was suggested, we didn't yet know the root cause (data and timing)

bmuenzenmeyer avatar Oct 21 '25 22:10 bmuenzenmeyer