Jiayi Zhao
Jiayi Zhao
Hi, thanks for the proposal, we will discuss about this sub pipeline concept with the team could you provide more context about your use case? based on my understanding, the...
Zohar, do you know if TF_SEQUENCE_EXAMPLE is supported by Transform?
The importer assumes the input is in supported format, it won't change the format, just register that as an artifact of that type
Is your module file on GCS (accessible by cloud)?
it has, your transform component need to access the module file, your dataflow runner don't need to access module file
seems your have the same issue as in [here](https://github.com/tensorflow/tfx/issues/3772#issuecomment-897785829)
so to confirm, your module file is on GCS, right?
Just curious, is [this](https://github.com/tensorflow/tfx/blob/master/tfx/examples/penguin/penguin_pipeline_kubeflow.py) example (Kubeflow instead of Vertex) working for you
The kubeflowDagRunner should work because of [this](https://github.com/tensorflow/tfx/blob/master/tfx/orchestration/kubeflow/kubeflow_dag_runner.py#L391) I created a [PR](https://github.com/tensorflow/tfx/pull/4766) to add that to kubeflowDagRunner V2, but currently there is a bug in PR sync so the PR status...
KubeflowDagRunner is for Kubeflow KubeflowV2DagRunner is for Vertex KubeflowDagRunner should work, and we found a potential fix[1] for KubeflowV2DagRunner. But you mentioned you saw the same "No module named 'user_module_0'"...