Slow / Inconsistent test performance on iOS real devices.

[vishnurv2]

What is your Scenario?

To execute testcafe tests on iOS real devices.

What is the Current behavior?

Test runs are extremely slow and often disconnect. On the other hand, tests are working fine on Android devices without any disconnection issues.

What is the Expected behavior?

Test performance should be comparable to android devices.

What is your public website URL? (or attach your complete example)

https://gap.com

What is your TestCafe test code?

import { Selector } from 'testcafe'; fixture GAP Sample .page https://gap.com;

test('Interacting with Gap.com', async t => {

const searchbut = Selector('button').withAttribute("aria-label", "Open search bar");
await t. click(searchbut)
console.log("✔️ Clicked to search")


//Type in search bar


const search = Selector('input').withAttribute("name", "searchText");
await t. typeText(search,'Shirt')
console.log("✔️ Entered search text 'Shirt'")
//Click search button
const searchbutton = Selector('button').withAttribute("aria-label", "search");
await t.click(searchbutton)
console.log('✔️ Clicked search button')


const rollcuff = Selector('img').withAttribute("name", "Oxford Shirt in Untucked Fit");
await t.click(rollcuff)
console.log('✔️ Clicked on Oxford Shirt in Untucked Fit')

await t.wait(2000)

const fifty = Selector('button').withAttribute("aria-label", "up to 50% off + extra 20% off");
await t.click(fifty)
console.log('✔️ Closed Offer Banner')

const size = Selector('input').withAttribute("aria-label", "L");
await t.click(size)
console.log('✔️ Selected size of the Shirt')

});

Your complete configuration file

No response

Your complete test report

vishnu@Admins-MacBook-Pro-2 testcafe-sample % testcafe remote gap_mobile.js --qr-code Using locally installed version of TestCafe. Connecting 1 remote browser(s)... Navigate to the following URL from each remote browser. You can either enter the URL or scan the QR-code. Connect URL: http://192.168.100.81:55816/browser/connect

CONNECTED Safari 15.0 / iOS 15.0.2 Running tests in:

• Safari 15.0 / iOS 15.0.2

GAP Sample ERROR The Safari 15.0 / iOS 15.0.2 browser disconnected. If you did not close the browser yourself, browser performance or network issues may be at fault.

Screenshots

No response

Steps to Reproduce

1. With the above test code in your project run the following command: testcafe remote gap_mobile.js --qr-code
2. Scan the generated QR code from an iOS real device. (The device and your test should be executed on the same network)
3. The testcafe connection is successful after scanning.

TestCafe version

1.18.4

Node.js version

v17.4.0

Command-line arguments

testcafe remote gap_mobile.js --qr-code

Browser name(s) and version(s)

Safari 15.0

Platform(s) and version(s)

iOS 15.0.2

Other

No response

[AlexKamaev]

Thank you for the detail description. I was able to reproduce the issue. I confirm that an error is thrown when you use your iPhone device as a remote.

I also tested the website on an Android device. It works on Android, but the test execution time is too long.

We'll research this issue. Please bear with us.

[vishnurv2]

@AlexKamaev Any progress on the above issue?

[github-actions[bot]]

No updates yet. Once we get any results, we will post them in this thread.

[vishnurv2]

Hi @AlexKamaev , any progress on the issue?

[github-actions[bot]]

No updates yet. Once we get any results, we will post them in this thread.

[okmttdhr]

Hi, the same situation occurs on macOS 11 and above for your information.

[panva]

I'm also running into frequent disconnects before the test suite actually runs on. This is with testcafe-browser-provider-browserstack, from github actions whilst using browserstack/github-actions/setup-env and browserstack/github-actions/setup-local with default values.

Using browserstack:iPhone 14 Pro Max@16 ERROR The Safari 16.0 / iOS 16.0.2 (https://automate.browserstack.com/builds/72b52813e5db0d0ebe3a287fea4dec77ff7eabe2/sessions/75f0f33fe7536f0f50f1f94d0ab276f3b02d1098) browser disconnected. If you did not close the browser yourself, browser performance or network issues may be at fault.

[AlexKamaev]

@panva We keep this ticket only for issues with real devices. Please create a separate ticket for your browserstack/github actions issue using the following template: https://github.com/DevExpress/testcafe/issues/new?assignees=&labels=TYPE%3A+bug&template=bug_report.yaml

[Artem-Babich]

Hello @vishnurv2,

Would you please clarify if you can reproduce the issue with the latest TestCafe version?

[github-actions[bot]]

This issue was automatically closed because there was no response to our request for more information from the original author. Currently, we don't have enough information to take action. Please reach out to us if you find the necessary information and are able to share it. We are also eager to know if you resolved the issue on your own and can share your findings with everyone.

[MohammedKamle]

any update on this issue ?

[PavelMor25]

Hello @MohammedKamle,

The issue was closed due to inactivity. If you encounter a similar issue, please create a separate ticket using this template.