kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

[KYUUBI #7206] [Lineage] support collecting filter condition tables

Open lyne7-sc opened this issue 5 months ago • 1 comments

Why are the changes needed?

The current lineage analysis misses tables that are only referenced in filter condition subqueries (e.g., in WHERE EXISTS or WHERE IN clauses). This PR adds an option to include these upstream dependencies.

Fixes https://github.com/apache/kyuubi/issues/7206

How was this patch tested?

UT added

Was this patch authored or co-authored using generative AI tooling?

No

lyne7-sc avatar Sep 18 '25 13:09 lyne7-sc

Codecov Report

:x: Patch coverage is 0% with 19 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 0.00%. Comparing base (fc04a3a) to head (f27c083). :warning: Report is 2 commits behind head on master.

Files with missing lines Patch % Lines
...in/lineage/helper/SparkSQLLineageParseHelper.scala 0.00% 14 Missing :warning:
.../org/apache/spark/kyuubi/lineage/LineageConf.scala 0.00% 5 Missing :warning:
Additional details and impacted files
@@          Coverage Diff           @@
##           master   #7207   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         696     696           
  Lines       43540   43559   +19     
  Branches     5891    5894    +3     
======================================
- Misses      43540   43559   +19     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov-commenter avatar Sep 19 '25 05:09 codecov-commenter