doris icon indicating copy to clipboard operation
doris copied to clipboard

[Feature] Support rollup and materialized view in nereids planner.

Open wangshuo128 opened this issue 3 years ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Description

Currently, OLAP table in nereids planner only supports the duplicated data model. Aggregate and Unique data models are not supported. This issue is for supporting aggregate and unique data models and support rollup and materialized view selection.

Subtasks for the issue:

  • [x] Main framework for selecting rollup index with aggregate plan node, pre-aggregation for OLAP scan is turned on by default. #12464
  • [ ] Support turning off pre-aggregation for OLAP scan table, e.g., select data without aggregate plan node, select by non-matching aggregate function type, etc. #12785
  • [ ] Support all the aggregate column types in the storage engine, such as bitmap, HLL, etc.
  • [ ] Support complex expressions in an aggregate function that could use pre-aggregation.
  • [ ] Support merge-on-write of the unique key model in nereids planner. (https://cwiki.apache.org/confluence/display/DORIS/DSIP-018%3A+Support+Merge-On-Write+implementation+for+UNIQUE+KEY+data+model)
  • [ ] Support materialized view selection for the duplicated data model.

Use case

N/A.

Related issues

No.

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

wangshuo128 avatar Sep 02 '22 08:09 wangshuo128