kyuubi
kyuubi copied to clipboard
[KYUUBI #7206] [Lineage] support collecting filter condition tables
Why are the changes needed?
The current lineage analysis misses tables that are only referenced in filter condition subqueries (e.g., in WHERE EXISTS or WHERE IN clauses). This PR adds an option to include these upstream dependencies.
Fixes https://github.com/apache/kyuubi/issues/7206
How was this patch tested?
UT added
Was this patch authored or co-authored using generative AI tooling?
No
Codecov Report
:x: Patch coverage is 0% with 19 lines in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 0.00%. Comparing base (fc04a3a) to head (f27c083).
:warning: Report is 2 commits behind head on master.
| Files with missing lines | Patch % | Lines |
|---|---|---|
| ...in/lineage/helper/SparkSQLLineageParseHelper.scala | 0.00% | 14 Missing :warning: |
| .../org/apache/spark/kyuubi/lineage/LineageConf.scala | 0.00% | 5 Missing :warning: |
Additional details and impacted files
@@ Coverage Diff @@
## master #7207 +/- ##
======================================
Coverage 0.00% 0.00%
======================================
Files 696 696
Lines 43540 43559 +19
Branches 5891 5894 +3
======================================
- Misses 43540 43559 +19
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
- :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.