prometheus
Silence does not seem to work until the alert is received from prometheus
What did you do?
- Had a Pending Alert in prometheus with
alertname=MyPendingAlert - Created a Silence in alertmanager for
alertname=MyPendingAlert
What did you expect to see? When the Alert went into Firing state and prometheus sent it to alertmanater i expected any notification for the alert to be suppressed
What did you see instead? Under which circumstances? The initial notification was not suppressed and a new alert was created , in my case, in opsgenie.
After that no further notification were sent and the alert was properly silenced
Environment
- System information: GKE 1.14.10
- Alertmanager version: 0.20.0
- Prometheus version: 2.16.0
You'd need to provide your configuration as well as Alertmanager logs (ideally with -log.level=debug).
Sure can do , but i will need a bit of time to get around doing all of it and replicate the issue
@primeroz has the issue occurred again? Even in v0.20.0 the silence should stop the notification pipeline if all alerts are muted
