kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

[FEATURE] [SPARK] add async fetch hdfs result

Open echo567 opened this issue 3 months ago • 1 comments

Code of Conduct

Search before asking

  • [x] I have searched in the issues and found no similar issues.

Describe the feature

During the Spark SQL execution phase, a thread pool is used when retrieving iterators to improve execution speed.

Motivation

Improve the speed of Spark SQL when retrieving results from HDFS

Describe the solution

Add a thread pool

Additional context

No response

Are you willing to submit PR?

  • [x] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
  • [ ] No. I cannot submit a PR at this time.

echo567 avatar Nov 02 '25 11:11 echo567

Hello @echo567, Thanks for finding the time to report the issue! We really appreciate the community's efforts to improve Apache Kyuubi.

github-actions[bot] avatar Nov 02 '25 11:11 github-actions[bot]