firehose
firehose copied to clipboard
raystack
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
Currently only ElasticSearch and MongoDB Sinks have support for JSON messages. Let's add support for parsing JSON messages in other sinks as well.
motivation going forward support for new data formats and bug fixes will be done in [depot](https://github.com/odpf/depot/)
Hello, Apologies in advance, I was unable to access the slack linked in the bug report menu. I am trying to connect Kafka to a Prometheus instance and I am...
Add a Troubleshooting section in Firehose documentation containing common runtime problems and their solutions. Sink - specific troubleshooting as well as generic issues ( related to Stencil client, Kafka consumer,...
### WHAT ? Remove dependency of [jaeger-client](https://github.com/jaegertracing/jaeger-client-node) from Firehose along with usages anywhere in the code. ### WHY ? As mentioned on their Github handle, Jaeger Clients are being deprecated...
### **WHAT ?** Deprecate config `SINK_HTTP_PARAMETER_SCHEMA_PROTO_CLASS` ### WHY ? For a Firehose with HTTP Sink configured with header or query parameter source ( that is, `SINK_HTTP_PARAMETER_SOURCE` != disabled), the proto...
Acceptance Criteria 1. Kafka, BQ both should be sources 2. Come up with the core design with which the solution will work. 3. Sinks are Kafka & Postgres
Support for parsing Kafka messages in Apache[ Avro ](https://avro.apache.org/docs/current/)schema format
Add support for [druid](http://druid.apache.org/docs/latest/development/extensions-core/kafka-ingestion.html) ingestion