metadata icon indicating copy to clipboard operation
metadata copied to clipboard

What integrations with other KF components are available/planned?

Open ryandawsonuk opened this issue 6 years ago • 3 comments

Let’s say I build a model using a TFJob, perhaps run from a KF pipeline (maybe using https://github.com/kubeflow/pipelines/blob/master/components/kubeflow/launcher/src/launch_tf_job.py). Will my metadata describing that model and it’s origin and training data be stored, or could I easily get it stored? I’m using this as an example but my question is really about any scenarios where models are built using KF components. Are there any examples or plans in this area?

ryandawsonuk avatar Jun 29 '19 20:06 ryandawsonuk

Right now we only integrate notebook via python library.

Next release, we will enable metadata tracking in KF Pipeline and Fairing. Training job triggered by them should have metadata automatically collected.

zhenghuiwang avatar Jul 03 '19 23:07 zhenghuiwang

@zhenghuiwang This would be great. The next release you mean is 0.7? BTW, any examples for current release (0.6) we can try?

Jeffwan avatar Jul 16 '19 21:07 Jeffwan

/kind question /area engprod /priority p2

jtfogarty avatar Jan 14 '20 22:01 jtfogarty