atf icon indicating copy to clipboard operation
atf copied to clipboard

[WIP] improve atf reporting

Open fmessmer opened this issue 5 years ago • 1 comments

ref https://github.com/mojin-robotics/atf/issues/12 ref https://github.com/floweisshardt/atf/issues/122

does not need to be merged right away....we might want to add some more... @floweisshardt wrt our discussion on slack

fmessmer avatar Jun 24 '20 10:06 fmessmer

this output also doesn't seem to be correct:

*************************
*** SOME TESTS FAILED ***
*************************
All tests OK
 - test 'ts0_c0_r1_e0_s0_0' (mrl-f, shelf, test_default, testblockset_minimal): 
   - testblock 'testblock_all_boxes': 
     - metric 'user_result': no result
   - testblock 'testblock_expected_boxes': 
     - metric 'user_result': no result
   - testblock 'testblock_manipulation':
     - metric 'user_result': no result
     - metric 'time': no result
 - test 'ts0_c0_r2_e0_s0_0' (mrl-g, shelf, test_default, testblockset_minimal): 
   - testblock 'testblock_all_boxes': 
     - metric 'user_result': no result
   - testblock 'testblock_expected_boxes': 
     - metric 'user_result': no result
   - testblock 'testblock_manipulation': 
     - metric 'user_result': no result
     - metric 'time': no result

"All tests OK" should have been replaced with Failed ATF tests: in https://github.com/floweisshardt/atf/blob/master/atf_core/scripts/analyser.py#L115-L148

fmessmer avatar Jun 24 '20 14:06 fmessmer