firebase-ios-sdk icon indicating copy to clipboard operation
firebase-ios-sdk copied to clipboard

[Sessions Integration Tests] fail running on macos-14

Open paulb777 opened this issue 1 year ago • 3 comments

Description

The tests fail. Fix and update session-integration-tests.yml to use macos-14

Testing failed: UITests_iOS-Runner (93978) encountered an error (The test runner failed to initialize for UI testing. (Underlying Error: Timed out while loading Accessibility.))

** TEST FAILED **

Reproducing the issue

https://github.com/firebase/firebase-ios-sdk/actions/runs/8638279486/job/23682376410

Firebase SDK Version

10.24.0

Xcode Version

15.3

Installation Method

CocoaPods

Firebase Product(s)

Crashlytics

Targeted Platforms

iOS

Relevant Log Output

No response

If using Swift Package Manager, the project's Package.resolved

Expand Package.resolved snippet

Replace this line with the contents of your Package.resolved.

If using CocoaPods, the project's Podfile.lock

Expand Podfile.lock snippet

Replace this line with the contents of your Podfile.lock!

paulb777 avatar Apr 12 '24 15:04 paulb777

Seems like it related to the performance issue for xcode15? I am seeing many discussions within the community: https://github.com/orgs/community/discussions/68807, https://discuss.circleci.com/t/severe-performance-problems-with-xcode-15/49205/47

Haven't be able to reproduce on local yet, I am on macOS 14.4.1, xcode15.2 tho, I'll try 15.3 then

themiswang avatar May 07 '24 17:05 themiswang

Hmmmm reran the job seems work this time https://github.com/firebase/firebase-ios-sdk/actions/runs/8638279486/job/24694636170, it references the head commit of this change, old job could be flaky.

themiswang avatar May 07 '24 18:05 themiswang

Some more evidence that the flakes are runner specific– actions/runner-images/#9591

I haven't investigated, but it is interesting that certain SDKs are failing (and then successfully re-running) consistently.

ncooke3 avatar May 08 '24 13:05 ncooke3