Object storage webhook events kick-off pipeline

[blairdrummond]

Proof of concept to show how MinIO bucket events could kick off a kubeflow pipeline.

See if we can prototype this! Would make a cool "Artifact Driven" workflow

[blairdrummond]

CC @Collinbrown95

[brendangadd]

@blairdrummond What do we do with this? Bucket events are cool; MinIO, less so.

[blairdrummond]

I think we have to start with an eventing system, like EventHub or EventGrid or whatever it's called, and then prove out how to generate events. I reckon that there's an azure-level primitive to generate blob storage events, we'd have to do it there. MinIO doesn't support events in proxy mode.

Once we have an event queue (generic) and then an event generator (specific), I think ArgoEvents lets you go the rest of the way to trigger workflows

[blairdrummond]

I think the Azure tool supports AMQP and Kafka btw

[Souheil-Yazji]

Could be revisited as "Kick off argo workflow on event to blob storage" ? Otherwise stale.