wankun

[SPARK-39080][SHUFFLE]Optimize shuffle error handler

4

### What changes were proposed in this pull request? Optimize ErrorHandler code. ### Why are the changes needed? Shuffle ErrorHandler only has two stateless method, so we do not need...

[SPARK-39893][SQL] Push limit 1 to the aggregate's child plan if grouping expressions and aggregate expressions are foldable

1

### What changes were proposed in this pull request? If all group expressions are foldable, the result of this aggregate will always be OneRowRelation. And if all aggregate expressions are...

Add support for spark configuration spark.sql.caseSensitive

2

Now spark-cassandra-connector tool is case sensitive by default when we create a cassandra table. We can use spark sql configuration parameter **spark.sql.caseSensitive** to determine if cassandra table is case sensitive...

[SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

12

### What changes were proposed in this pull request? This PR will run `scheduleShuffleMergeFinalize()` and send `finalizeShuffleMerge` RPCs in two threads, and stop all work after `PUSH_BASED_SHUFFLE_MERGE_RESULTS_TIMEOUT` regardless of sucess...

[WIP][SPARK-40480][SHUFFLE] Remove push-based shuffle data after query finished

8

### What changes were proposed in this pull request? Cleanup merged shuffle data files after query finished. ### Why are the changes needed? There will be too many merged shuffle...

[SPARK-40306][SQL]Support more than Integer.MAX_VALUE of the same join key

2

### What changes were proposed in this pull request? Support more than Integer.MAX_VALUE of the same join key. ### Why are the changes needed? For SMJ, the number of the...

PARQUET-2415: Reuse hadoop file status and footer in ParquetRecordReader

7

Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Parquet Jira](https://issues.apache.org/jira/browse/PARQUET/) issues and references them in the PR title. For example,...

[VL][MINOR] Don't link libjemalloc_extension.a of DuckDB if BUILD_JEMALLOC_EXTENSION is OFF

2

## What changes were proposed in this pull request? Minor change ## How was this patch tested? Fix compile issue

[BUG] Unable to call alibaba Qwen models with Open AI provider

1

**Bug Description** Hi, I can call alibaba Qwen model with Open AI python library and curl command. But I can not call the Qwen model in chatbox. I don't known...

[#1938] improvement: Use ShuffleSegment to replace FileBasedShuffleSegment and BufferSegment

2

### What changes were proposed in this pull request? Now the BufferSegment class and FileBasedShuffleSegment class both six fields, represents a segment. ```java private long blockId; private long offset; private...