fluent-plugin-prometheus icon indicating copy to clipboard operation
fluent-plugin-prometheus copied to clipboard

How to scarpe metrics in mutliworker mode

Open bobykus31 opened this issue 6 years ago • 3 comments

We run fluentd with 32 workers as it is a bit loaded, does it mean I need to have 32 HTTP endpoints configured on Prometheus server starting from 24231 when

<source>
  @type prometheus
  bind 0.0.0.0
  port 24231
  metrics_path /metrics
</source>

Or is there any way to accumulate metrics on one port?

bobykus31 avatar Apr 09 '19 12:04 bobykus31

does it mean I need to have 32 HTTP endpoints configured on Prometheus server starting from 24231 when

Yes. See README: https://github.com/fluent/fluent-plugin-prometheus#prometheus-input-plugin

repeatedly avatar Apr 09 '19 15:04 repeatedly

This means that /metrics only takes port 24231,If I use multiple workers, the url is useless

xidiandb avatar Mar 20 '20 02:03 xidiandb

aggregated_metrics_path which was implemented so that users can get metrics from one port and one endpoint might help. https://github.com/fluent/fluent-plugin-prometheus/tree/31ca6065cee88a58d3d5a2dcebe095983b7cefda#prometheus-input-plugin

ganmacs avatar Mar 23 '20 03:03 ganmacs