Bo Gao

> Mind filing a JIRA? Yeah, will do, thanks!

> @bogao007 - this PR is doing a lot. Could we please atleast a high level description of what files are being added, how they are being used and what...

> @bogao007 - test failure seems related ? > > ``` > [error] /home/runner/work/spark/spark/sql/core/src/main/scala/org/apache/spark/sql/execution/python/TransformWithStateInPandasExec.scala:51:12: class TransformWithStateInPandasExec needs to be abstract. > [error] Missing implementation for member of trait StatefulOperator: >...

Hi @HyukjinKwon, I'm getting below testing errors with my PR: ``` ====================================================================== ERROR [0.255s]: test_termination_sigterm (pyspark.tests.test_daemon.DaemonTests.test_termination_sigterm) Ensure that daemon and workers terminate on SIGTERM. ---------------------------------------------------------------------- Traceback (most recent call last):...

> The test failure doesn't look related to me. Can you reproduce it locally? Yeah I can reproduce it locally which is weird... And after I reverted the changes in...

@HyukjinKwon I got some other dependency errors for tests running in yarn and k8s ``` [info] - run Python application in yarn-client mode *** FAILED *** (4 seconds, 30 milliseconds)...

@HyukjinKwon I fixed the dependency issue, could you help take another look? Thanks!

@HyukjinKwon could you help take another look? Thanks!

> Looks fine at high level Thanks @HyukjinKwon! I addressed your comments, could you help take another look?

> +1 > > Please leave a comment listing all JIRA tickets for TODOs, for record/reference. Thanks a lot @HeartSaVioR! Here are the TODOs related to this PR: https://issues.apache.org/jira/browse/SPARK-49233 https://issues.apache.org/jira/browse/SPARK-49100...