fluent
Support Redis output
Is your feature request related to a problem? Please describe.
We use stream based topology for our logs, similar like described in Vector documentation:
https://vector.dev/docs/setup/deployment/topologies/#stream-based
where in our case, currently:
- Filebeat is a log collector
- Redis (x N) is a stream storage
- Vector is ETL to transform and forward
- and Elastic is meant as storage
To test replacing Filebeat with Fluentbit, we need support in Fluentbit to push data to Redis compatible storage (using "compatible" term here as it would work with Dragonfly or Redis forks as well).
Describe the solution you'd like Support Redis as output in Fluentbit. It should support configuring many output addresses (x N) and some load balancing to those targets (i.e via timestamp modulo).
Describe alternatives you've considered None, evaluating Fluentbit as replacement for Filebeat.
Additional context Submitting this issue as a result of discussion at Kubecon 2024 Paris.
This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
we are using the similar solution, but filebeat only support one output destination. search and find fluent-bit, but looks like it doesn't support Redis
I was looking for redis but couldn't find anything. So, decided to use HTTP output pointing to an API which handles the redis write.
This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.
This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.
This issue was closed because it has been stalled for 5 days with no activity.