Submitty icon indicating copy to clipboard operation
Submitty copied to clipboard

Port Selenium tests to Cypress

Open skara9 opened this issue 2 years ago • 0 comments

Currently, we do e2e testing in both selenium and cypress, two different testing frameworks. This slows down our workflows and requires more effort to maintain. Most of our selenium tests are also flagged to be skipped on CI mostly due to the lack of necessary components. The codebase has changed significantly while all of these tests were being skipped, so it is likely that a majority of them need major refactor if they are to work at all with the current or future codebase.

Furthermore, the tests that do work in CI fail most of the time. Workflows often need to be re-run 3-4 times before they pass selenium. This makes ongoing development challenging and slows productivity.

Hence, we will be gradually porting over the selenium tests to cypress so we can run all of our e2e tests under the single framework, saving time and energy.


Here is the breakup of our current selenium tests that need to be rewritten in Cypress, along with their complexity (represented with ✦'s), and the number of tests that are currently being run in CI:

  • [x] #9337
    • Relies on java dependency and config files
  • [x] #9338
    • Currently fails the most often (on merge_threads)
  • [x] #9339
  • [x] #9340
  • [x] #9341
    • Out of sync with latest sample queue data
  • [x] #9342
  • [x] #9343
  • [x] #9344
  • [x] #9345
  • [x] #9346
  • [x] #9347

skara9 avatar May 23 '23 16:05 skara9