datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Enable parquet filter pushdown by default

Open alamb opened this issue 3 years ago • 0 comments

In https://github.com/apache/arrow-datafusion/pull/3380 @thinkharderdev added support for evaluating filters during the parquet scan via the RowIndex mechanism 🎉

This feature is currently enabled via a feature flag, which is disabled by default.

This ticket tracks enabling this feature by default.

Currently known items are:

  • [ ] https://github.com/apache/arrow-datafusion/issues/3457
  • [ ] Review of parquet test coverage and add additional coverage as needed
  • [ ] Enable this feature by default

alamb avatar Sep 13 '22 10:09 alamb