connect icon indicating copy to clipboard operation
connect copied to clipboard

[FEATURE] Add Azure EventHub as an Benthos Input

Open ghstahl opened this issue 2 years ago • 3 comments

Is this on the roadmap? Does a third party one exist?

I am currently using the kafka input, but the azure eventHub in kafka mode is causing intermittent dropouts. I have seen this in benthos and my own stuff using segmentio's kafka-go client.

Time to have a first class implementation using the azure go eventhub sdk?

ghstahl avatar Jan 18 '24 16:01 ghstahl

Hi, If we're talking about a Microsoft SDK integration, does it make sense to integrate an input & output for the Azure Service Bus, too?

I would be interested in both integrations

There is also an SDK for this. https://github.com/Azure/azure-sdk-for-go/tree/main/sdk/messaging

best Regards

HukaufA avatar Feb 02 '24 02:02 HukaufA

I would also be interested in this.

cthtrifork avatar Apr 25 '24 06:04 cthtrifork

The issue isn't the Kafka client SDKs, its azure EventHub itself. It's a Kafka pretender and about once a day we get flooded with errors emitted from anything kafka consuming. Hence that ask for a direct azure sdk integration.

I think if you knock down EventHub then hopefully the rest of the integrations follow a similar pattern.

EventHub, ServiceBus, ....

ghstahl avatar Apr 25 '24 14:04 ghstahl