paimon-rust icon indicating copy to clipboard operation
paimon-rust copied to clipboard
verified publisher icon apache

Implement FileIndex

Open devillove084 opened this issue 1 year ago • 3 comments

  • [x] Implement basic IO Module
  • [ ] Implement a FunctionVistor(may be a simple one for poc) and FieldRef for FileIndexReader
  • [x] Implement FileIndexFormat and FileIndexWriter/Reader and other interface
  • [ ] Implement BitmapFileIndex
  • [ ] Implement BloomfilterFileIndex

Regarding the work of implementing FileIndex, I will split it into multiple PRs to facilitate review and comment, so that there will be no problems in the implementation due to deviations in my personal understanding.

devillove084 avatar Aug 02 '24 16:08 devillove084

I've made some effort to separate the following implementation. If you have any suggestions for further improvement, please let me know. cc @Xuanwo

devillove084 avatar Aug 02 '24 16:08 devillove084

Thanks a lot for starting this!

Xuanwo avatar Aug 02 '24 16:08 Xuanwo

There is a new IndexFile called bit-slice bitmap index, i would like to try fellow your IndexFile framework to try to implement this functionality https://github.com/apache/paimon/pull/4464

suxiaogang223 avatar Nov 30 '24 08:11 suxiaogang223