citrus-admin icon indicating copy to clipboard operation
citrus-admin copied to clipboard

DISABLED tests (XML definition) show as successful in UI

Open gucce opened this issue 8 years ago • 0 comments

Problem

In my test suite (Citrus 2.7.1, XML tests), I have disabled some tests via

<status>DISABLED</status>

As expected, they are skipped by Citrus (not by TestNG or JUnit!):

17:27:15,038 INFO         citrus.Citrus| CITRUS TEST RESULTS
17:27:15,038 INFO         citrus.Citrus|
17:27:15,039 INFO         citrus.Citrus|  IT_001_xxxxxxxxxxxxxxxxxxxxxxxxxxxx ............................ SKIPPED
17:27:15,039 INFO         citrus.Citrus|  IT_002_xxxxxxxxxxxxxxxxxx ...................................... SKIPPED
17:27:15,039 INFO         citrus.Citrus|  IT_003_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ..................... SKIPPED
17:27:15,039 INFO         citrus.Citrus|  IT_004_xxxxxxxxxxxxxxxxx ....................................... SUCCESS
17:27:15,039 INFO         citrus.Citrus|  IT_005_xxxxxxxxxxxxxx .......................................... SKIPPED
17:27:15,039 INFO         citrus.Citrus|  IT_006_xxxxxxxxxxxxxxxxxxxxxxxx ................................ SKIPPED
17:27:15,039 INFO         citrus.Citrus|  IT_007_xxxxxxxxxxxxxx .......................................... SUCCESS
17:27:15,039 INFO         citrus.Citrus|  IT_009_xxxxxxxxxxxxxxxxxx ...................................... SUCCESS
17:27:15,039 INFO         citrus.Citrus|  IT_010_xxxxxxxxxxxxxxxxxxxxxxxxxxx ............................. SUCCESS
17:27:15,039 INFO         citrus.Citrus|

However, the Citrus Admin UI show the tests as successfully executed. It obviously only parses the TestNG/JUnit results.

tests_censored

gucce avatar Jul 12 '17 10:07 gucce