IVCT_Framework icon indicating copy to clipboard operation
IVCT_Framework copied to clipboard

Allow IVCT to run headless

Open PHameete opened this issue 7 years ago • 4 comments

Currently, the IVCT requires an operator to peform manual operations to start testing a SuT:

  • Select a SuT + Conformance Statement
  • Configure TcParams for the tests to perform.

In the ideal case it should be possible to provide the IVCT with a set of parameters / configuration and to run a headless test of a SuT + Conformance statement without operator input.

This would allow us to use the IVCT + a containerized SuT to run automated integration tests.

PHameete avatar May 18 '18 09:05 PHameete

One idea would be to extend the current UI with a scripting" mode. This script would then contain the SuT to be tested, and it would schedule all tests contained in the badges within the conformance statement of the SuT.

rhzg avatar May 23 '18 12:05 rhzg

I guess this is covered somehow in the earlier comments: my wish is to start the IVCT with a test file containing a description of the test cases to execute. The IVCT should then completely execute without user interaction, basically returning 0 (on success) or -1 (on error). The results should be captured in a TBD format.

bergtwvd avatar Jun 11 '18 13:06 bergtwvd

For test cases within a test suite, this can be archived with issue #94 and the proposal for an execution wrapper

rhzg avatar Jul 10 '20 08:07 rhzg

As there is not request for this feature in the final operational capability, this feature request will be postpone to "future enhancements"

rhzg avatar Aug 11 '20 13:08 rhzg