save-cli
save-cli copied to clipboard
saveourtool
Universal test framework for cli tools [mainly for code analyzers and compilers]
`kotest-assertions` support multiplatform and are much more expressive than what's available in `kotlin.test`. For example, this code ```kotlin reporter.results.forEach { testResult -> assertTrue(!testResult.debugInfo!!.execCmd!!.contains("chapter")) } ``` will fail with `Expected value...
Discussed with @petertrr - we should run tests in parallel. One scope is the test. And plugins can be run one-by-one in the scope of one test Parallel run of...
After all these commands are executed, Plugin performs it's logic. Can be properly supported in configs after ktoml supports TOML arrays. For now, can be done as a comma-separated string
* Download dependencies (e.g., the binary, which is used in `execCmd`) * Set up environment variables
In the test `execute warn plugin with timeout()[jvm]`: `org.opentest4j.AssertionFailedError: expected: but was: `. This error occurs very rarely (but in #310 I've seen it twice already, both on MacOS, but...
For now we use `examples` dir as test resources more and more actively, however we should show in examples only the main functionality of SAVE All low level testing should...
Maybe it's better to use PID and usual `kill`? `ps aux`: ``` root 8 0.0 0.1 10468 2904 ? S 06:59 0:00 sh -c (./save-0.3.0-alpha.0.6+dd046c2-linuxX64.kexe standard-test-suites STANDARD_-670060430_-1178785914/CWE584_Return_in_Finally_Block/CWE584_Return_in_Finally_Block__basic_01.java STANDARD_-670060430_-1178785914/CWE584_Return_in_Finally_Block/CWE584_Return_in_Finally_Block__basic_02.java STANDARD_-670060430_-1178785914/CWE584_Return_in_Finally_Block/CWE584_Return_in_Finally_Block__basic_03.java STANDARD_-670060430_-1178785914/CWE584_Return_in_Finally_Block/CWE584_Return_in_Finally_Block__basic_04.java...
`org.cqfn.save.core.integration.ClassicWarnTest` fails on MacOS (probably, after update to Kotlin 1.6.0 and other related dependency updates) with `ProcessExecutionException: Stream closed` being thrown instead of `ProcessTimeoutException`. This test has failed at least...
Since Kotlin 1.6.0, mingw target is compiled on all three agents. This leads to duplication and errors. We should either filter out mingw on Linux and MacOS, or fully embrace...
Metadata
Owner
Metadata
Universal test framework for cli tools [mainly for code analyzers and compilers]