kyuubi
kyuubi copied to clipboard
[FEATURE] [SPARK] add async fetch hdfs result
Code of Conduct
- [x] I agree to follow this project's Code of Conduct
Search before asking
- [x] I have searched in the issues and found no similar issues.
Describe the feature
During the Spark SQL execution phase, a thread pool is used when retrieving iterators to improve execution speed.
Motivation
Improve the speed of Spark SQL when retrieving results from HDFS
Describe the solution
Add a thread pool
Additional context
No response
Are you willing to submit PR?
- [x] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
- [ ] No. I cannot submit a PR at this time.
Hello @echo567, Thanks for finding the time to report the issue! We really appreciate the community's efforts to improve Apache Kyuubi.