ClickHouse icon indicating copy to clipboard operation
ClickHouse copied to clipboard

Add Hudi and DeltaLake table engines

Open rubin-do opened this issue 3 years ago • 1 comments

Changelog category (leave one):

  • New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

  • Add Hudi and DeltaLake table engines, read-only, only for tables on S3

Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/

rubin-do avatar Sep 06 '22 15:09 rubin-do

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Sep 07 '22 07:09 CLAassistant

Integration tests (tsan) [1/4] — fail: 1

test_grpc_protocol_ssl/test.py::test_secure_channel

kssenii avatar Nov 08 '22 11:11 kssenii

Question about these two table engines: currently implementation will get all data files when creating the table, but the iceberg/hudi table may have data written after table creation, while we just can read the data at the moment of table creation.

ucasfl avatar Nov 15 '22 15:11 ucasfl

Question about these two table engines: currently implementation will get all data files when creating the table, but the iceberg/hudi table may have data written after table creation, while we just can read the data at the moment of table creation.

create a PR with the improvement?

kssenii avatar Nov 15 '22 16:11 kssenii