apache
add inverted index of timeseries
Description
Add the inverted index of the timeseries to optimize the time series query for a small number of timelines. Similar to tsi.
Proposal
Build: Option 1: Add index to memtable and build it when data is written. Option 2: Build when memtable flushes to sst.
Storage: Option 1: Store in parquet metadata. Option 2: Store in separate file.
iox 已经去掉了 inverted index, 全靠 datafusion 执行引擎 table scan
In some scenes(like point query used in alerts), batch scan may be much more expensive compared to scaning/getting filterd rows with the inverted index. And now inverted index feature is currently in the poc stage, and we will decide the next step based on specific performance tests.
