ios-sdk-examples icon indicating copy to clipboard operation
ios-sdk-examples copied to clipboard

ExamplesUITests flapping: testAnimatedLineExample and testCustomAnnotationView

Open friedbunny opened this issue 7 years ago • 3 comments

The examples UI tests added in #175 are erratically failing on Bitrise at 00c3769732d6a430b169da99b3a127d16577955b, like so:

ExamplesUITests

testAnimatedLineExample, Asynchronous wait failed: Exceeded timeout of 30 seconds, with unfulfilled expectations: "Expect Darwin notification 'com.mapbox.examples.example-complete'". ExamplesUITests.m:48

testCustomAnnotationView, Failed to scroll to visible (by AX action) Button, 0x600000186320, traits: 8589934593, identifier: 'MGLMapViewCompassId', label: 'Compass', value: north, error: Error -25204 performing AXAction 2003 on element <XCAccessibilityElement: 0x7fc1d1d1ddb0> pid: 2547, elementOrHash.elementID: 140725414443456.565 ExamplesUITests.m:78

/cc @julianrex @captainbarbosa

friedbunny avatar Sep 07 '18 16:09 friedbunny

FWIW the tests are sporadically failing for me on Xcode 10 / iPhone 6 iOS 12 simulator. Yet to try Xcode 9.3.

julianrex avatar Sep 07 '18 17:09 julianrex

FWIW the tests are sporadically failing for me on Xcode 10 / iPhone 6 iOS 12 simulator.

This was due to Xcode 10's new parallel build system, and insert-mapbox-token build script phase requiring an explicit input file. See https://github.com/mapbox/ios-sdk-examples/commit/8f986e4e25d4306cb6cbd7be89ecebad4be436b4

julianrex avatar Sep 10 '18 19:09 julianrex

These tests have continued to be unreliable, so they were disabled in #237.

friedbunny avatar Oct 09 '18 21:10 friedbunny