Sagar Sumit
Sagar Sumit
Also, if you query using spark.read.format("hudi"), do you see the right records? I am trying to figure out if this is an issue with hive _rt tables only.
@eric9204 For the first failure, can you share the full write configs? Was there any pending/inflight compaction and clustering? Can you share the `.hoodie` directory under the base path of...
I would suggest to upgrade to version 0.10.1, or if you can wait for a couple of weeks, then 0.12.0 will be out. It's already in RC voting phase. You're...
Interesting! If I understand correctly, @fengjian428 's suggestion is to go back to a previous snapshot if the latest one is corrupt. Hudi already supports time travel. However, @melin 's...
@Gatsby-Lee You mentioned > since it will raise an exception, you have to wrap the Spark Write. What exception did you get? I ran a test locally and tried to...
Btw, `org_id=55555_\$folder$` maybe an S3 thing. Did the partition `org_id=55555` ever existed before?
@Gatsby-Lee Thanks for the info. I will wait for more updates from you after testing with 0.11.1. However, I can think of one thing which we can improve. Before executing...
@Gatsby-Lee Gentle reminder. Can we close this issue?
@Gatsby-Lee Thanks and I have noted your point. Would you mind upstreaming your fix (logic that checks if the target partition exists). I believe this would be helpful for other...
@ksrihari93 Did you try with `auto.offset.reset=LATEST`?