microsoft
[Gold Standard] Updated plans for all tpcds queries with spark-only setup
What is the context for this pull request?
- Parent Issue: #334
- Dependency: #383, #384
What changes were proposed in this pull request?
In this PR we have updated plans for all tpcds queries q2-q99. Please review the dependency PR #384 first which contains the code for creating and validating golden files (query plan files) for gold standard.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Unit tests
Note to reviewers, currently q49 doesn't work well with the build pipelines so as per offline suggestions I have removed it from this PR. I will add it back once the issue is resolved.
@apoorvedave1 Could you do this?
- Take resource files from OSS Spark and create a PR, and we will just merge quickly.
- Rebase this PR.
The reason is I want to make sure changes other than the expression reorder didn't go in.
@apoorvedave1 Could you do this?
- Take resource files from OSS Spark and create a PR, and we will just merge quickly.
- Rebase this PR.
The reason is I want to make sure changes other than the expression reorder didn't go in.
Ok sure, let me get back.
This is an initial setup with spark only (non-hyperspace) version of gold standard. Please refer parent proposal for more details
Could you update this PR description as well? Not easy to follow which portion of parent proposal applies to this PR.
Are the test failures related to the cross join?
@imback82 yeah outside of the test function it was not picking up the config for enabling cross join. I made slight changes to the code and it works now. Please take a look