vinjai

Results 26 comments of vinjai

@kevinjqliu @Fokko I can take this forward if no one is actively working on this.

Hey @sungwy I am working on this at the moment Will open the PR for review by next week

PR is ready for review

Hi @Fokko I would like to give a shot at this if no one has already taken it.

Hey @Fokko Question around transformation defined in SortOrder: Our input for sorting is a pyarrow table in the append and override methods. Here we have two options: 1. Sort the...

For instance (in BucketTransform): https://github.com/apache/iceberg-python/blob/0bf175d25de706a3aa094d81093faff4057295be/pyiceberg/transforms.py#L303-L304

This PR solves for: 1. Writing sorted datasets to a partitioned or non-partitioned iceberg table. 2. Generating manifests with correct sort-order-id. 3. Integration tests to make sure sorted datasets are...

@Fokko This PR is ready for review

@sungwy @kevinjqliu This PR is ready for review

Fixed another bug. Writes with same name but different ref types were being successful. This is a bug in the current release version too Please review whenever you get some...