refactor(web): spin off deduplication, suggestion-similarity sections 📚

[jahorton]

Continuing from #11899, this spins of the suggestion-deduplication and the suggestion-similarity-detection sections into their own methods. The two were a bit entangled, so it was simplest to split them off at the same time.

While no unit tests are added here for either, these changes will make it much simpler to establish some that are focused solely on each of the two methods in the future.

@keymanapp-test-bot skip

[keymanapp-test-bot[bot]]

User Test Results

Test specification and instructions

User tests are not required

Test Artifacts

• Android
  • Keyman for Android apk
  • FirstVoices for Android 16.0 apk
  • FirstVoices Keyboards for Android apk
  • KeyboardHarness apk
  • Keyman for Android 16.0 apk
  • KMSample1 apk
  • KMSample2 apk
• Developer
  • Keyman Developer
  • Compiler Regression Tests
  • kmcomp.zip
• iOS
  • Keyman for iOS (simulator image)
  • FirstVoices Keyboards for iOS (simulator image)
  • TestFlight internal PR build version - 18.0.75 (0.11900.11494)
• Keyboards
  • Test Keyboards
• Web
  • KeymanWeb Test Home
• Windows
  • Keyman for Windows
  • FirstVoices Keyboards for Windows
  • Text Editor (32 bit)
  • Text Editor (64 bit)

[jahorton]

Is there a set of regression tests we can run on the whole predict() function after these refactors?

There's a pretty solid set of automated tests that have really helped me out in this regard while developing. They've helped catch a number of issues during this process... and I've also added more automated tests to further validate everything.

I don't know if there's an extensive set of regression user tests yet or not. If desired, I could spend some time drafting some; I've become more aware of various limitations and edge cases as a result of all of this.

[keyman-server]

Changes in this pull request will be available for download in Keyman version 18.0.75-alpha