incubator-xtable icon indicating copy to clipboard operation
incubator-xtable copied to clipboard

[722] Implement iceberg versions for TableFormat and HoodieTableMetadata

Open bvaradar opened this issue 8 months ago • 0 comments

Important Read

ISS-722 Add Iceberg Pluggable table format managed directly by Hudi

What is the purpose of the pull request

ISS-722 Add Iceberg Pluggable table format managed directly by Hudi Feature Request: Support for Pluggable Table Format in Apache Hudi

Apache Hudi is introducing a pluggable table format to enable interoperability with other popular table formats like Iceberg, Delta Lake, and Lance. This allows external engines (e.g., Snowflake) to write to Hudi tables using their native formats while maintaining compatibility. The design focuses on decoupling metadata and storage layers, inspired by Snowflake's metadata architecture. This enhancement supports the modular, composable lakehouse model and promotes broader ecosystem adoption.

This is the first PR

Corresponding Hudi PR : https://github.com/apache/hudi/pull/13216

Brief change log

(for example:)

  • Fixed JSON parsing error when persisting state
  • Added unit tests for schema evolution

Verify this pull request

(Please pick either of the following options)

This pull request is a trivial rework / code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end.
  • Added TestConversionController to verify the change.
  • Manually verified the change by running a job locally.

bvaradar avatar Jun 02 '25 23:06 bvaradar