orama icon indicating copy to clipboard operation
orama copied to clipboard

Add TF-IDF weights to tokens

Open micheleriva opened this issue 3 years ago • 3 comments

This PR is still a work in progress. The algorithms are just POCs and highly inefficient, once we validate the idea, I'll proceed to optimize them.

micheleriva avatar Jul 30 '22 10:07 micheleriva

Heyy, this is pretty neat! 💯 Especially for multi word searches.

I really like the idea.


Will it be in symbiosis with tolerance ?

thomscoder avatar Aug 01 '22 09:08 thomscoder

It shouldn't affect how typo tolerance work, but I really need to optimize this before trying 😄

micheleriva avatar Aug 01 '22 09:08 micheleriva

I guessed, i really like the idea 😄

thomscoder avatar Aug 01 '22 09:08 thomscoder

Closing this PR in favor of this Lyra plugin: https://github.com/LyraSearch/plugin-token-relevance

micheleriva avatar Aug 28 '22 08:08 micheleriva