Junfan Zhang

When the data type in the DataFrame does not meet the requirements of the Analyzer(like `completeness`, `compliance`), the final analysis result may be empty or may not be empty. This...

Analyzer should support param of hint

4

**Check** has hint param, but **Analyzer** not. it's necessary to support it.

Support storing shuffle data to secured dfs cluster

36

### What changes were proposed in this pull request? Support storing shuffle data to secured HDFS cluster by spark job user's own permission in shuffle server side. ### Why are...

[Improvement] Avoid unnecessary retry in some access checker when using DelegationShuffleManager

11

The retry mechanism is introduced by #127. But in some access checker, there's no need to retry, like candidates checker. But the health checker maybe need. So I think we...

Introduce more grpc server metrics

1

### What changes were proposed in this pull request? Introduce more grpc server metrics 1. grpc_server_executor_active_threads 2. grpc_server_executor_blocking_queue_size 3. grpc_server_connection_size ### Why are the changes needed? Now if the executors...

[Improvement] Fine-grained shuffle manager fallback at the shuffle level

8

### Motivation Now uniffle's delegation shuffle manager support fallback to sort shuffle manager in app level. We could implement it in shuffle level.

[Improvement] Avoid starting unused threads in spark driver

2

### What changes were proposed in this pull request? Avoid starting unused threads in spark driver ### Why are the changes needed? In Spark RssShuffleManager, for the role of driver,...

Use NIO's Files API to replace FileInputStream/FileOutputStream in some paths

10

### What changes were proposed in this pull request? Use NIO's Files API to replace FileInputStream/FileOutputStream in some paths. ### Why are the changes needed? Follow this PR of spark:...

[Performance Optimization] Multiple channels when getting shuffle data in client side

6

### Motivation Now the executor only will use the single TCP connection with the specified shuffle server, so when multiple tasks are running concurrently, it will share this channel. Maybe...

Benchmark: ESS and Uniffle

4

Could the community provide the official benchmark with ESS and uniffle?