keyman icon indicating copy to clipboard operation
keyman copied to clipboard

chore(web): add additional data to debug #13908

Open ermshiperete opened this issue 8 months ago • 4 comments

It seems #13908 isn't completely fixed yet, but it's unclear what values we get that would trigger the bug. This change adds the variables we get in the hopes that this will reveal something.

Related-to: #13908

User Testing

TEST_SMOKE: Install this version on iOS, add EuroLatin keyboard and do a smoke test. Run this test on as many devices as possible (hardware and emulator).

ermshiperete avatar Jun 02 '25 17:06 ermshiperete

User Test Results

Test specification and instructions

Retesting Template
Test-bot: retest TEST_SMOKE

keymanapp-test-bot[bot] avatar Jun 02 '25 17:06 keymanapp-test-bot[bot]

Test Results

Test device specifications: Physical Device: iPhone SE iOS 15.8.3 & Keyman v19.0.56-alpha-test-0.14102. The results are as followed:

  • TEST_SMOKE (FAILED):
  1. Install Keyman 19.0.56-test-0.14102.13704 on iOS 15.8.3 with TestFlight
  2. Launch Keyman --> Info --> Confirmed the version
  3. The EuroLatin (SIL) v3.0.3 was already installed
  4. Tried installing shan 1.1.1, sundanese 1.0.7, sil_ipa 2.0.1, and shaw_2layer 1.0.1
    • Note: No alerts or error behaviors come up.
  5. Checked sentry and saw this https://keyman.sentry.io/issues/6653249451/?project=5983524&query=is%3Aunresolved%20issue.priority%3A%5Bhigh%2C%20medium%5D&referrer=issue-stream&stream_index=1 during the time of testing.
  6. Tried to produce a consistent behavior but failed, such as:
    • Installing mentioned and other keyboards
    • Typing with EuroLatin and switching keyboards
    • Deleting EuroLatin
    • Reinstalling EuroLatin with Albanian and English language
    • Adjusting the keyboard height
    • Idling until phone screen locks
  7. Note: When closing the app with a keyboard displaying, the "Keyman" Crashed window always show up: https://github.com/user-attachments/assets/51ab7338-4838-46ab-a894-b16fcde55e19 I submitted three crash reports.

Note: No sentry or error came up when tested on Simulator: macOS v15.4.3, Xcode 16.3 with iOS 16.4 and physical device: iOS 18.1.1.

@ermshiperete, should I mark this test as a PASSED?

Meng-Heng avatar Jun 03 '25 08:06 Meng-Heng

Update: The video recording of crash report is at the same time and frontend of this sentry: https://keyman.sentry.io/issues/6653435226/?project=5983524&query=is%3Aunresolved%20issue.priority%3A%5Bhigh%2C%20medium%5D&referrer=issue-stream&stream_index=1

Meng-Heng avatar Jun 03 '25 08:06 Meng-Heng

@ermshiperete, should I mark this test as a PASSED?

Mark it as failed. It shouldn't crash.

ermshiperete avatar Jun 03 '25 14:06 ermshiperete

This attempt did not work. Closing since I think I found the the cause of the bug and fixed it in #14684.

ermshiperete avatar Sep 04 '25 16:09 ermshiperete