Xiduo You
Xiduo You
cc @wangyum @viirya @cloud-fan how about this idea ?
+1 with @maryannxue comment. Otherwise the idea looks good, also cc @cloud-fan
cc @cloud-fan @viirya thank you
> BTW, does filter pushdown have the same issue? no The conflicts issue has been hacky fixed in ColumnPruning https://github.com/apache/spark/blob/c2536a7eabd8764cbbaaff22935e19685b92f22b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala#L819-L829 Due to the subexpression elimination in codegen, the complex expression...
https://github.com/apache/spark/pull/35856 has tried the similar things although at present it miss the details of the compile time for each phase. And its scope also includes the AQE, I think is...
@yliou I agree both can help for troubleshooting. And I have mentioned the difference, `it miss the details of the compile time for each phase`. That PR introduces a disk-based...
cc @cloud-fan @sigmod @wangyum
cc @cloud-fan @huaxingao if you have time to take a look, thank you
cc @cloud-fan @viirya thank you
is it possible to shade the kyuubi dependencies into lineage plugin ?