Sagar Sumit
Sagar Sumit
@nitinkul @vicuna96 Since primary key and precombine field rarely change, could you try setting these in [hudi-defaults.conf](https://hudi.apache.org/docs/configurations/#externalized-config-file) and retry?
I could not reproduce with the latest master. Sharing the spark-sql and spark-shell scripts in this gist: https://gist.github.com/codope/f9e89093b98e58ad097820a35376caed
@vicuna96 This is expected and I believe the NPE was fixed by https://github.com/apache/hudi/commit/1f173127e4980eff0b6ad99ce9db1bda8dae0d32
@huzk8 Can you please try the patch authored by @YannByron #6264
@yabola Thanks for putting up this PR. Sorry for the delay as I was occupied with Hudi release work. I am going to review it towards the end of week....
@Nazerra Any update on this issue? Did you try with OCC enabled?
@brightwon Can you please rebase?
The validation is legitimate, i.e. for a completed instant the marker dir is removed, so rollback cannot be done based on markers. Just to go past this issue, you can...
@jtchen-study Ideally, rollback is triggered only for failed writes. As such fallback to listing-based rollback should be safe but we need to understand how rollback got triggered for completed instant....
Looks like it is an open issue of Parquet format iself that has not yet been resolved https://issues.apache.org/jira/browse/PARQUET-1681 This seems to affect even the latest version 1.12.0 and the parquet...