flutter
Mac_x64 module_test_ios is 3.00% flaky
The post-submit test builder Mac_x64 module_test_ios had a flaky ratio 3.00% for the past (up to) 100 commits, which is above our 2.00% threshold.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692 Commit: https://github.com/flutter/flutter/commit/d3c274b25540de40e17693ce6800454b5f32ecb8
Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).
[2024-03-03 19:56:51.382516] [STDOUT] stdout: t = 34.02s Get number of matches for: Elements matching predicate '"This is Marquee" IN identifiers'
[2024-03-03 19:56:52.057342] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.tfsA5B/hello_host_app/FlutterUITests/FlutterUITests.m:122: error: -[FlutterUITests testDualCold] : Asynchronous wait failed: Exceeded timeout of 30 seconds, with unfulfilled expectations: "Expect predicate `count == 2` for object <XCUIElementQuery: 0x600002140230>".
[2024-03-03 19:56:52.059265] [STDOUT] stdout: t = 34.70s Tear Down
[2024-03-03 19:56:52.303887] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (34.944 seconds).
The simulator rebooted in the middle of the test, which would be an Xcode issue.
This looks the same as https://github.com/flutter/flutter/issues/142125. https://github.com/flutter/flutter/pull/143967 added retry logic for testFlutterViewWarm but this one is testDualCold.
[2024-03-01 04:45:29.765690] [STDOUT] stdout: t = 66.75s Checking `Expect predicate `exists == 1` for object "Flutter iOS Demos Home" NavigationBar`
[2024-03-01 04:45:29.766683] [STDOUT] stdout: t = 66.75s Checking existence of `"Flutter iOS Demos Home" NavigationBar`
[2024-03-01 04:45:29.791278] [STDOUT] stdout: t = 66.77s Capturing element debug description
[2024-03-01 04:45:29.968312] [STDOUT] stdout: t = 66.95s Checking existence of `"Flutter iOS Demos Home" NavigationBar`
[2024-03-01 04:45:29.991019] [STDOUT] stdout: t = 66.97s Capturing debug information
[2024-03-01 04:45:29.992448] [STDOUT] stdout: t = 66.97s Requesting snapshot of accessibility hierarchy for app with pid 45473
[2024-03-01 04:45:30.174742] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.Yt9NmR/hello_host_app/FlutterUITests/FlutterUITests.m:126: error: -[FlutterUITests testDualCold] : (([app.navigationBars[@"Flutter iOS Demos Home"] waitForExistenceWithTimeout:kStandardTimeOut]) is true) failed
[2024-03-01 04:45:30.176602] [STDOUT] stdout: t = 67.16s Tear Down
[2024-03-01 04:45:30.445736] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (67.426 seconds).
It's rebooting randomly in the middle of these tests on random "waits" so just doing the retry on "Increment via Flutter" isn't enough, it needs to be all waits. 🤮
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 Commit: https://github.com/flutter/flutter/commit/894620b8c54b789d2bfb10acfe249a6adcf08bdb Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-13 and 2024-03-19 is 4.00%. Flaky number: 4; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260 Commit: https://github.com/flutter/flutter/commit/98369bdd502718eb4c9630c6b24a0b338cde4134 Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/240 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/235 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/215
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 Commit: https://github.com/flutter/flutter/commit/894620b8c54b789d2bfb10acfe249a6adcf08bdb Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-19 and 2024-03-26 is 2.00%. Flaky number: 2; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360 Commit: https://github.com/flutter/flutter/commit/33739617209f511560daeeb761d8c58bd42ac4ff Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/311
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-04 and 2024-03-07 is 4.23%. Flaky number: 3; total number: 71. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 Commit: https://github.com/flutter/flutter/commit/894620b8c54b789d2bfb10acfe249a6adcf08bdb Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-26 and 2024-04-02 is 2.00%. Flaky number: 2; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/449 Commit: https://github.com/flutter/flutter/commit/bca1d6ad1ffda8022ee89bda70e16413dd8a80b8 Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/449 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/437
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-03 and 2024-04-09 is 3.00%. Flaky number: 3; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610 Commit: https://github.com/flutter/flutter/commit/b5b916557c3419a6273be83a77677a159ed3760b Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/591 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/531
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-06 and 2024-04-16 is 4.00%. Flaky number: 4; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/698 Commit: https://github.com/flutter/flutter/commit/08bae320c586a4cb5a4f2dccda88d8fb44dd3ce0 Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/698 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/693 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/675 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-17 and 2024-04-23 is 1.00%. Flaky number: 1; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/814 Commit: https://github.com/flutter/flutter/commit/d737b7bae0cbd5952a804fbfd9d41cf70e8002ed Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/814
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-23 and 2024-04-30 is 3.00%. Flaky number: 3; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/921 Commit: https://github.com/flutter/flutter/commit/07db2c4d55b8bfd973e6bf5f600a9edcc0154a6c Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/921 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/896 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/885
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-05-01 and 2024-05-07 is 2.00%. Flaky number: 2; total number: 100. One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1025 Commit: https://github.com/flutter/flutter/commit/2e8c9fb5d56d962a67b3cf6342e9188f0b65d53b Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1025 https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1023
Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
Deleting with https://github.com/flutter/flutter/pull/148264, this test isn't adding anything.
This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}