CI: correct test selection propagation for service-specific tests and run them conditionally
Motivation
This PR addresses two current issues with test selections, specifically:
- missing propagation of test selection files to service-specific tests
- issue with unnecessary job startup if no service-specific code was updated
Changes
- Add
TESTSELECTION_PYTEST_ARGStoPYTEST_ARGSfor provider specific tests - Add a step to identify changed services and use its output to conditionally trigger service-specific jobs
Testing
- Test that only Integration tests are triggered if S3 test has been changed https://github.com/localstack/localstack/pull/12750
- Test that Integration tests and DynamoDB-v2 tests are triggered https://github.com/localstack/localstack/pull/12751
- Test that all tests are triggered when workflow is triggered on master
Test Results - Preflight, Unit
21β630 testsβ +17βββ19β973 β +15βββ7m 2s β±οΈ +2s βββββ1 suites Β±β0ββββ1β657 π€ +β2β βββββ1 filesββ Β±β0ββββββββ0 β Β±β0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.
Test Results (MA/MR) - Preflight, Unit
21β630 testsβ +17βββ19β973 β +15βββ6m 8s β±οΈ -13s βββββ1 suites Β±β0ββββ1β657 π€ +β2β βββββ1 filesββ Β±β0ββββββββ0 β Β±β0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.
Test Results (amd64) - Acceptance
7 testsβ Β±0βββ5 β Β±0βββ3m 22s β±οΈ +15s 1 suites Β±0βββ2 π€ Β±0β 1 filesββ Β±0βββ0 β Β±0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.
Test Results (amd64, MA/MR) - Acceptance
7 testsβ Β±0βββ5 β Β±0βββ3m 11s β±οΈ -8s 1 suites Β±0βββ2 π€ Β±0β 1 filesββ Β±0βββ0 β Β±0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.
Test Results - Alternative Providers
987 testsβββ589 β ββ30m 19s β±οΈ ββ4 suitesββ398 π€ ββ4 filesββββββ0 β
Results for commit 82634230.
:recycle: This comment has been updated with latest results.
Test Results (MA/MR) - Alternative Providers
987 testsβββ589 β ββ30m 34s β±οΈ ββ4 suitesββ398 π€ ββ4 filesββββββ0 β
Results for commit 82634230.
:recycle: This comment has been updated with latest results.
Test Results (amd64) - Integration, Bootstrap
ββββ5 filesβ Β±β0ββββββ5 suitesβ Β±0βββ2h 22m 34s β±οΈ + 2m 13s 5β242 tests +12ββ4β313 β +12ββ929 π€ Β±0ββ0 β Β±0β 5β248 runsβ +12ββ4β313 β +12ββ935 π€ Β±0ββ0 β Β±0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.
Test Results (amd64, MA/MR) - Integration, Bootstrap
ββββ5 filesβ Β±β0ββββββ5 suitesβ Β±0βββ2h 22m 50s β±οΈ +24s 5β242 tests +12ββ4β313 β +12ββ929 π€ Β±0ββ0 β Β±0β 5β248 runsβ +12ββ4β313 β +12ββ935 π€ Β±0ββ0 β Β±0β
Results for commit 73f835e4.βΒ± Comparison against base commit 3bbf9442.
:recycle: This comment has been updated with latest results.