atf
atf copied to clipboard
[WIP] improve atf reporting
ref https://github.com/mojin-robotics/atf/issues/12 ref https://github.com/floweisshardt/atf/issues/122
does not need to be merged right away....we might want to add some more... @floweisshardt wrt our discussion on slack
this output also doesn't seem to be correct:
*************************
*** SOME TESTS FAILED ***
*************************
All tests OK
- test 'ts0_c0_r1_e0_s0_0' (mrl-f, shelf, test_default, testblockset_minimal):
- testblock 'testblock_all_boxes':
- metric 'user_result': no result
- testblock 'testblock_expected_boxes':
- metric 'user_result': no result
- testblock 'testblock_manipulation':
- metric 'user_result': no result
- metric 'time': no result
- test 'ts0_c0_r2_e0_s0_0' (mrl-g, shelf, test_default, testblockset_minimal):
- testblock 'testblock_all_boxes':
- metric 'user_result': no result
- testblock 'testblock_expected_boxes':
- metric 'user_result': no result
- testblock 'testblock_manipulation':
- metric 'user_result': no result
- metric 'time': no result
"All tests OK" should have been replaced with Failed ATF tests: in https://github.com/floweisshardt/atf/blob/master/atf_core/scripts/analyser.py#L115-L148