CodeceptJS icon indicating copy to clipboard operation
CodeceptJS copied to clipboard

Skipped tests are shown in cli report within test execution

Open vitaliisotnichenko opened this issue 1 year ago • 6 comments

What are you trying to achieve?

In cli within test execution to see only passed/failed tests

What do you get instead?

While test execution except passed/failed tests, skipped tests also displayed that make track execution more difficult

Screenshot 2024-10-27 at 10 31 37

Details

  • CodeceptJS version: 3.6.5
  • NodeJS Version: 20
  • Operating System: Mac/Linux
  • playwright: 1.38.1
  • Configuration file:
    /** Mocha reporter */
    mocha: {
        reporterOptions: {
            "codeceptjs-cli-reporter": {
                stdout: "-",
                options: {
                    verbose: true,
                    features: true,
                }
            },
            "mocha-junit-reporter": {
                stdout: "-",
                options: {
                    mochaFile: 'output/result.[hash].xml',
                    includePending: false,
                }
            }
        }
    },

vitaliisotnichenko avatar Oct 27 '24 10:10 vitaliisotnichenko

skipped tests are displayed with flag --reporter mocha-multi

vitaliisotnichenko avatar Oct 29 '24 09:10 vitaliisotnichenko

well, I think the skipped tests are displaying by default and currently, there is not option to hide them.

kobenguyent avatar Oct 29 '24 15:10 kobenguyent

@kobenguyent they didn't display in 3.5.2 version, the problem appeared after this version when we did update. We did rollback to the 3.5.2 version and again no issue with skipped tests, they shown only in result line Screenshot 2024-10-29 at 17 10 36

vitaliisotnichenko avatar Oct 29 '24 16:10 vitaliisotnichenko

Could you kindly verify if you have observed this issue since the release of version 3.6.x?

kobenguyent avatar Nov 08 '24 07:11 kobenguyent

@kobenguyent I can see this issue in 3.5.8 version but in 3.5.2 it works correctly (without skipped tests in cli)

vitaliisotnichenko avatar Nov 08 '24 08:11 vitaliisotnichenko

Facing the same issue with the latest version. Resulting in elevated counts in the allure report.

@kobenguyent

myrepojuly avatar Nov 27 '24 11:11 myrepojuly