wire-android icon indicating copy to clipboard operation
wire-android copied to clipboard

ci: github acceptance improvements [WPB-8666] [WPB-9133]

Open Garzas opened this issue 1 year ago • 18 comments

TaskWPB-8666 [Android] Setup pipeline step to run acceptance tests on CI


PR Submission Checklist for internal contributors

  • The PR Title

    • [ ] conforms to the style of semantic commits messages¹ supported in Wire's Github Workflow²
    • [ ] contains a reference JIRA issue number like SQPIT-764
    • [ ] answers the question: If merged, this PR will: ... ³
  • The PR Description

    • [ ] is free of optional paragraphs and you have filled the relevant parts to the best of your ability

What's new in this PR?

  • Run acceptanceTests on GitHub Actions, only for develop, release/candidate, prod , internal and main or PR targeting those branches
  • Preserve logic to archive tests results with commit hash

Garzas avatar May 15 '24 09:05 Garzas

Test Results

932 tests  ±0   932 :white_check_mark: ±0   9m 9s :stopwatch: - 5m 46s 124 suites ±0     0 :zzz: ±0  124 files   ±0     0 :x: ±0 

Results for commit 4999fc29. ± Comparison against base commit d4ec2b55.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar May 15 '24 09:05 github-actions[bot]

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 15 '24 11:05 github-actions[bot]

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 15 '24 12:05 github-actions[bot]

Build 4756 succeeded.

The build produced the following APK's:

AndroidBob avatar May 15 '24 12:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 15 '24 14:05 github-actions[bot]

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 15 '24 15:05 github-actions[bot]

Build 4761 succeeded.

The build produced the following APK's:

AndroidBob avatar May 15 '24 15:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 16 '24 06:05 github-actions[bot]

Build 4771 succeeded.

The build produced the following APK's:

AndroidBob avatar May 16 '24 06:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 16 '24 08:05 github-actions[bot]

Build 4775 succeeded.

The build produced the following APK's:

AndroidBob avatar May 16 '24 08:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 16 '24 14:05 github-actions[bot]

Build 4786 succeeded.

The build produced the following APK's:

AndroidBob avatar May 16 '24 15:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 17 '24 10:05 github-actions[bot]

Build 4789 succeeded.

The build produced the following APK's:

AndroidBob avatar May 17 '24 10:05 AndroidBob

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 17 '24 12:05 github-actions[bot]

Build 4796 succeeded.

The build produced the following APK's:

AndroidBob avatar May 17 '24 12:05 AndroidBob

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 44.20%. Comparing base (d4ec2b5) to head (4999fc2).

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #3007      +/-   ##
===========================================
- Coverage    44.35%   44.20%   -0.15%     
===========================================
  Files          447      447              
  Lines        14559    14558       -1     
  Branches      2498     2497       -1     
===========================================
- Hits          6457     6436      -21     
- Misses        7399     7426      +27     
+ Partials       703      696       -7     

see 3 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update d4ec2b5...4999fc2. Read the comment docs.

codecov-commenter avatar May 20 '24 06:05 codecov-commenter

APKs built during tests are available here. Scroll down to Artifacts!

github-actions[bot] avatar May 20 '24 06:05 github-actions[bot]

Build 4803 succeeded.

The build produced the following APK's:

AndroidBob avatar May 20 '24 07:05 AndroidBob