PROFESSIONAL-CLOUD-DEVOPS-ENGINEER · Question #21
You encounter a large number of outages in the production systems you support. You receive alerts for all the outages that wake you up at night. The alerts are due to unhealthy systems that are automa
The correct answer is A. Eliminate unactionable alerts.. To prevent staff burnout from frequent, unnecessary nighttime alerts due to self-recovering systems, the best SRE practice is to eliminate alerts that do not require human intervention.
Question
Options
- AEliminate unactionable alerts.
- BCreate an incident report for each of the alerts.
- CDistribute the alerts to engineers in different time zones.
- DRedefine the related Service Level Objective so that the error budget is not exhausted.
How the community answered
(68 responses)- A75% (51)
- B6% (4)
- C15% (10)
- D4% (3)
Why each option
To prevent staff burnout from frequent, unnecessary nighttime alerts due to self-recovering systems, the best SRE practice is to eliminate alerts that do not require human intervention.
Alerts generated by systems that automatically recover quickly and do not require human intervention are considered unactionable. Eliminating these alerts aligns with SRE principles by focusing human attention only on issues that truly need it, thereby reducing alert fatigue and preventing staff burnout.
Creating an incident report for every self-resolving, non-actionable alert would significantly increase operational toil without adding value, exacerbating burnout.
Distributing unactionable alerts to engineers in different time zones only spreads the burnout geographically without addressing the root cause of the excessive alerting.
Redefining the SLO to accommodate the current error rate would simply mask the issue and might lower the quality of service, rather than addressing the problem of excessive, unactionable alerts.
Concept tested: SRE alert management and toil reduction
Source: https://sre.google/sre-book/monitoring-alerting/#alert-management
Topics
Community Discussion
No community discussion yet for this question.