javascript icon indicating copy to clipboard operation
javascript copied to clipboard

Prevent abbreviations from stemming

Open nataliashitova opened this issue 6 years ago • 0 comments

Summary

Short all-caps abbreviations should not be stemmed using general rules. This unwanted behavior leads to stemming, e.g., CTA to ctum in English.

Explanation

In consultation with Team Lingo we've decided that all all-caps words 2, 3, and 4 characters long should be prevented from stemming. The result of relevantWords researches should then include abbreviations in a shape of WordCombinations, where word is an all-caps abbreviation, stem is a lower-case abbreviation, occurrences is a number of occurrences.

nataliashitova avatar Mar 27 '19 09:03 nataliashitova