apache
Is there any performance report in tpc-h or tpc-ds with Apache Spark and Gluten?
What is the problem the feature request solves?
No response
Describe the potential solution
No response
Additional context
No response
@thexiay Not yet. We still have some issues to resolve until we can fully run TPC-H or TPC-DS and publish our benchmark results. Please stay tuned.
@thexiay Not yet. We still have some issues to resolve until we can fully run TPC-H or TPC-DS and publish our benchmark results. Please stay tuned.
maybe you can upload One-click TPC-H or TPC-DS test script in other branch or main(e.g. you mentioned it in #141) and I can solve part of bugs while runing TPC-H or TPC-DS @sunchao
@thexiay it's possible to run TPC-DS locally with Comet via following the steps in this file. #141 will require some work to implement.
We now have the Comet Benchmarking Guide which shows current benchmark results, and all of the TPC-H scripts are open source as part of the new DataFusion Benchmarks repo, so I think we can close this issue now.
I know this issue asked about Gluten, but we do not plan on publishing benchmarks for other accelerators but the community is welcome to do so and we have provided all the scripts to enable this.
