iceberg-go icon indicating copy to clipboard operation
iceberg-go copied to clipboard

feat: glue table creation with some docs on testing

Open wolfeidau opened this issue 2 years ago • 3 comments

This change adds table creation which for the most part replicates the functionality in the iceberg python library.

I have verified this works with the glue service now by using spark, and the python iceberg client to interact with the table.

wolfeidau avatar Feb 02 '24 08:02 wolfeidau

any updates @wolfeidau?

zeroshade avatar Apr 23 '24 18:04 zeroshade

@zeroshade I will dig into this in the next few days, I have implemented the builder for tables but need a way to have a generic path builder.

Given I have time off next week I can dig into it more.

wolfeidau avatar Apr 25 '24 20:04 wolfeidau

@zeroshade I have had a shot at tidying this feature and addressing your feedback.

  • moved cfn to root of the project and ditched the docs folder
  • moved table meta data name generation to table package
  • added a builder for the table
  • isolated and generified the metadata related writing
  • remove the default location as it isn't necessary

wolfeidau avatar Jun 09 '24 03:06 wolfeidau