Matt Casters

As a feature request it would be great to see the current automatic behavior with respect to encryption setting extend to the neo4j+s protocol used with Aura. The same thing...

Using ParquetIO: https://beam.apache.org/releases/javadoc/2.19.0/org/apache/beam/sdk/io/parquet/ParquetIO.html

https://beam.apache.org/releases/javadoc/2.14.0/index.html?org/apache/beam/sdk/transforms/Partition.html It should be possible to support basic Kettle partitioning in the sense that we can call the partitioning plugin of choice and generate the pipeline accordingly.

Support generic Ketle input steps.

1

Steps like Data Grid, CSV Input, Table Input, ... Meant for small, non-parallel data sets.

For those runners which need to be executed on a remote server using the environment of the runner, we need remote execution possibilities. This is the case for Beam runners...

Implement step error handling

1

Probably by moving everything to multiple PCollections, one for data, one for errors.

FileDefinition : Create/Update using step output

1

Add new menu items in Spoon/Beam: * Create File definition using step output * Update File definition using step output