search-benchmark-game

search-benchmark-game copied to clipboard

Use same BM25 k1/b parameters across engines.

1

The k1 and b parameters of BM25 can influence what hits may be dynamically pruned and thus performance numbers, so it would be good to use the same values across...

jpountz

Recommend scoring hits with BM25(k1=0.9,b=0.4).

4

Currently different engines use different parameters for BM25, e.g. Tantivy and Lucene use (k1=1.2,b=0.75) while PISA uses (k1=0.9,b=0.4). Robertson et al. had initially suggested that 1.2/0.75 would make good defaults...

jpountz

It seems to me that the pisa-0.8.2 engine forces evaluation of all hits with the TOP_10_COUNT task, but it doesn't collect them into a priority queue as I would expect....

jpountz

add new field id_num add range queries over id_num 

PSeitz

fmassot

Like: - time to index - memory usage for indexing

fmassot

Don't know if it's hard or not :/

fmassot

Add luceneplusplus

2

https://github.com/luceneplusplus/LucenePlusPlus

sonic182

Capture relevant hardware information (cpu type, Cache sizes, ...) and display it in the benchmark.

fulmicoton

Add sphinx search

1

https://sphinxsearch.com/

DirectorX