Missing test results in ReportPortal when using pabot
Describe the bug I am executing multiple test suites via pabot and wants to upload the test results to ReportPortal, but i am missing a lot of test cases. In my robot logfile i can see 68 test case have been executed, but only 39 have been uploaded to ReportPortal. Some suite results are not uploaded at all and for some uploaded suites i am missing of few test cases.
Steps to Reproduce Steps to reproduce the behavior:
- Run robot with pabot - i run 10 test suites, but seperated into different packages via ordering.txt file to not run everything in parallel.
- Configure reportportal listener for your robot command
- Check uploaded results in report portal
Expected behavior Every test suite & test case that got executed is uploaded with the related test result into the report portal launch.
Actual behavior I am missing test results in ReportPortal for some of the test cases / suites.
Package versions Python 3.12 robotframework 7.2.2 reportportal-client 5.5.10 robotframework-reportportal 5.5.8
Additional context See screenshots from ReportPortal & the file directory where the pabot results from the execution are saved
I just thought about the issue once again & I have one doubt: I am using only two processes for my pabot execution - could this lead to issue I am facing ? I will try to increase the processes count & come back to you.
I just thought about the issue once again & I have one doubt: I am using only two processes for my pabot execution - could this lead to issue I am facing ? I will try to increase the processes count & come back to you.
I have tested it, but i am still missing some test results in ReportPortal. I think this needs to get investigated within this listener.