Linux Labs

Observability: metrics, alerts, logs / Stage 5 of 9

Alertmanager: to whom and how many times

Not running Starting usually ~20 s
Leave the lesson

Step 6 of 6 · summary · 2 min

Summary

  • Alertmanager sends a notification per group; group_by decides which alerts end up together, and ['...'] makes every alert a group.
  • group_wait, group_interval and repeat_interval set when the first notification, the change report and the repeat go out.
  • amtool silence add mutes notifications by labels for a set time; silenced alerts stay in Alertmanager, and amtool alert query --silenced shows them.
  • routes with matchers split alerts between receivers: the first matching route takes the alert, and amtool config routes test shows which.
  • The 50 notifications at the start of the lesson came from group_by: ['...']: each of the 50 InstanceDown alerts was a group of its own.
Ubuntu 24.04
Loading…