Joel
Joel
Have you tried using the [IbisTableDataset](https://kedro.org/blog/building-scalable-data-pipelines-with-kedro-and-ibis)? It's lazy by default so selecting columns should feel more ergonomic in kedro.
I've wanted conditional nodes for a long time, @idanov 's strong argument against the combinatorial complexity they introduce is a very valid argument for what Kedro is and isn't. The...
I think it involves more of spike to work out how it would actually work. I think Flyte (LFAI), Dagster and Metaflow all fall into the modern orchestrator space which...
Aligned - I also think Dagster is closer to Kedro than the others in terms of granularity. In recent years they've really invested in their dbt integration and perhaps we...
Super cool work!
Don't have much to add other than - I love that this is getting momentum it feels like a really powerful pattern
great work!
We've never been able or reconcile Kedros reproducibility mission with this requirement. I'd be tempted to introduce a new node type that enables upserts, conditionals etc in a backwards compatible...
Also plus 1 for ibis everything
I think it would have be injected here - but I'm not sure https://github.com/kedro-org/kedro/blob/0293dc15812b27330bba31a01c7b332b3165af2a/kedro/framework/project/__init__.py#L142