conduit icon indicating copy to clipboard operation
conduit copied to clipboard

Make it possible for processor to return multiple records

Open hariso opened this issue 3 years ago • 2 comments

Feature description

Currently, a processor accepts a single record as an input, and returns a single record as an output.

It would be good if the processor would return multiple records for the following reasons:

  • According to @ahmeroxa it's fairly when going to relational databases (e.g. from a denormalized to a normalized data model)
  • Some other tools use that too (e.g. Benthos), so doing a switch to Conduit would be easier.

hariso avatar Sep 15 '22 16:09 hariso

@ahmeroxa is there a actual need for this currently? Otherwise going to delay this until after 0.8.0 when we will tackle splitting and combining records more wholistically.

simonl2002 avatar Jul 31 '23 16:07 simonl2002

@simonl2002 it's not currently blocking any active projects, so it can wait.

ahmeroxa avatar Jul 31 '23 17:07 ahmeroxa