Keerthimanu comments

Results 6 comments of


                                            Keerthimanu

[SUPPORT] Setting hoodie.datasource.insert.dup.policy to drop still upserts the record in 0.14

> @keerthiskating This setting is only applicable when operation type is insert. > > > > > > Any idea how do I achieve this when doing upsert operation? I...

[SUPPORT] Setting hoodie.datasource.insert.dup.policy to drop still upserts the record in 0.14

@ad1happy2go I do not have the bandwidth to contribute. @codope Any idea this will be supported / Do you think this is a valid use case?

[SUPPORT] Hudi write to COW table hangs on Preparing compaction metadata job

@ad1happy2go I do not have access to EMR cluster and so unable to run the spark-submit. However, I explicitly set following parameters to allow for aggressive cleaning. Even then, first...

[SUPPORT] Hudi write to COW table hangs on Preparing compaction metadata job

I tried reading the metadata table alone using [Can the Hudi Metadata table be queried?](https://stackoverflow.com/questions/66137089/can-the-hudi-metadata-table-be-queried) in a separate spark job and it hangs. @nsivabalan thoughts?

[SUPPORT] Hudi write to COW table hangs on Preparing compaction metadata job

No logs are being sent to cloudwatch, it is getting stuck at Preparing compaction metadata: gft_fact_consol_hudi_metadata

[SUPPORT] Hudi write to COW table hangs on Preparing compaction metadata job

@ad1happy2go I do not have an EMR cluster to run spark-submit. I am using Glue.