skytable icon indicating copy to clipboard operation
skytable copied to clipboard

Feature: Full text search

Open lsabi opened this issue 4 years ago • 3 comments

Description An approach I found often online, is to use a full text search engine such as apache solr for creating and querying the database content, in combination with a key value datastore, such as redis for retrieving the matching items, based on the keys returned from the search.

Adding an index, that can be full text searchable or even simple B+ trees, would be a nice feature.

There exist already some libraries for full text search written in rust, such as https://github.com/tantivy-search/tantivy

Not sure if it supports also geoindexing such as lucene.

lsabi avatar Sep 29 '21 20:09 lsabi

Hey, thanks for the suggestion! I'll be back with you on this matter a little later. @glydr remind

ohsayan avatar Oct 01 '21 11:10 ohsayan

Just to clarify, by FTS I'm going to assume that you're looking for a way to search across all values in the database (that ofc is for binary strings/unicode strings and not lists). Or if I'm getting you wrong, are you referring to searches for keys by prefixes?

ohsayan avatar Mar 02 '22 15:03 ohsayan

I was assuming the first one.

Though, key prefixes/suffixes/ranges could also be an idea, in particular where composite keys are used and partial key search is needed.

lsabi avatar Mar 02 '22 21:03 lsabi