Add Iceberg Pluggable table format managed directly by Hudi

Open bvaradar opened this issue 8 months ago • 1 comments

Feature Request / Improvement

Feature Request: Support for Pluggable Table Format in Apache Hudi

Apache Hudi is introducing a pluggable table format to enable interoperability with other popular table formats like Iceberg, Delta Lake, and Lance. This allows external engines (e.g., Snowflake) to write to Hudi tables using their native formats while maintaining compatibility. The design focuses on decoupling metadata and storage layers, inspired by Snowflake's metadata architecture. This enhancement supports the modular, composable lakehouse model and promotes broader ecosystem adoption.

I will add the PR to integrate Iceberg plugin for this.

Are you willing to submit PR?

[x] Yes I am willing to submit a PR!

Code of Conduct

[x] I agree to follow this project's Code of Conduct

Jun 02 '25 23:06 bvaradar

References for context.

https://github.com/apache/hudi/blob/master/rfc/rfc-93/rfc-93.md https://medium.com/@balajivaradarajan/rock-paper-scissors-pluggable-table-format-in-apache-hudi-80a72e864695

Jun 30 '25 15:06 vinishjail97