conduit icon indicating copy to clipboard operation
conduit copied to clipboard

Data isn't parsed from S3 Source if the file has more than one record

Open uchennakevinm1 opened this issue 3 years ago • 0 comments

Data isn't parsed from S3 Source if the file has more than one record Example data: an example of the file with which data is transferred {"id": 44, "name": "Bob"} an example of the file with which data isn't transferred {"id": 44, "name": "Bob"} {"id": 45, "name": "Alex"}

Logs: 2022-05-09T09:28:09+00:00 ERR node stopped error="node 61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stopped with error: error receiving ack: failed to get payload: failed to unmarshal data into structured data: invalid character '{' after top-level value" component=pipeline.Service node_id=61381064-cf71-47d9-8c93-9a1e0d6c5415-acker stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/connector/destination.go","func":"github.com/conduitio/conduit/pkg/connector.(*destination.Ack","line":194},{"file":"/Users/serhii/conduit/pkg/plugin/standalone/v1/destination.go","func":"github.com/conduitio/conduit/pkg/plugin/standalone/v1.(*destinationPluginClient.Ack","line":120}]

uchennakevinm1 avatar Aug 25 '22 00:08 uchennakevinm1