Rex(Hui) An

[SPARK-39389]Filesystem closed should not be considered as corrupt files

9

### What changes were proposed in this pull request? Should throw the error if caused by Filesystem closed when we enable ignoreCorruptFiles ### Why are the changes needed? If we...

[HUDI-3189] Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table

3

## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request...

[SUPPORT] Doing clustering for bulked insert table, could cause: Can't redefine: list

3

**_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at [email protected]. - If you...

## What changes were proposed in this pull request? Livy could not dispose rpc server if session is not created successfully. To reproduce this issue, 1. Create a session with...

[LIVY-706] ThriftServer does not actually cancel jobs if we Interrupt querys from beeline

3

## What changes were proposed in this pull request? If we type `Ctrl + c` to interrupt a query from beeline, it does not cancel itself, the job still can...

[HUDI-4881] Push down filters if possible when syncing partitions to Hive

1

### Change Logs If possible, try to push down filters to Hive to avoid fetching too many partitions. ### Impact _Describe any public API or user-facing feature change or any...

手持机dll文件无法添加引用

1

手持机的API的Demo是基于WinCE系统的，可以将IDE更换为VS2005、VS2008再进行尝试。

[HUDI-6129] Support rate limit for Spark streaming source

3

### Change Logs 1. Add `InstantOffset` to allow read instant partially 2. Add `InstantOffsetRange` to support filtering files btw startOffset(exclusive) and endOffset 3. Spark3 implements `SupportsAdmissionControl` to support rate limit...

Why this cannot support speculation

5

Is there any spark issues that I can track this random task attempt ids problem? I test a lot of cases, but I can not reproduce this. Thanks in advance....

[SUPPORT] Hudi could override users' configurations

2

We recently also met the issue https://github.com/apache/hudi/issues/9305, but with the different cause(we still use hudi 0.12). The user set the configure `spark.sql.parquet.enableVectorizedReader` to false manually, and read a hive table...