nerdexam
Google

PROFESSIONAL-CLOUD-DEVOPS-ENGINEER · Question #153

You are running an experiment to see whether your users like a new feature of a web application. Shortly after deploying the feature as a canary release, you receive a spike in the number of 500 error

The correct answer is A. Roll back the experimental canary release.. Upon observing a spike in errors and increased latency after a canary release, the immediate action to minimize negative user impact is to roll back the problematic release.

Submitted by lucia.co· Apr 18, 2026Managing a service incident

Question

You are running an experiment to see whether your users like a new feature of a web application. Shortly after deploying the feature as a canary release, you receive a spike in the number of 500 errors sent to users, and your monitoring reports show increased latency. You want to quickly minimize the negative impact on users. What should you do first?

Options

  • ARoll back the experimental canary release.
  • BStart monitoring latency, traffic, errors, and saturation.
  • CRecord data for the postmortem document of the incident.
  • DTrace the origin of 500 errors and the root cause of increased latency.

How the community answered

(24 responses)
  • A
    83% (20)
  • B
    4% (1)
  • C
    4% (1)
  • D
    8% (2)

Why each option

Upon observing a spike in errors and increased latency after a canary release, the immediate action to minimize negative user impact is to roll back the problematic release.

ARoll back the experimental canary release.Correct

A canary release is designed to test new features with a small subset of users and provides a quick rollback mechanism if issues arise. Rolling back the experimental canary release immediately removes the faulty code from production, stopping the negative impact (500 errors, increased latency) on users and preventing further degradation of service.

BStart monitoring latency, traffic, errors, and saturation.

Monitoring these metrics should already be in place as part of standard operations and certainly before/during a canary release; starting to monitor them now is too late to mitigate an active incident.

CRecord data for the postmortem document of the incident.

Recording data for a postmortem is an important step *after* the incident is stabilized or resolved, not the first action to take when actively minimizing user impact.

DTrace the origin of 500 errors and the root cause of increased latency.

Tracing the root cause is crucial for a permanent fix and preventing recurrence, but it's a diagnostic step that comes after immediate mitigation to restore service.

Concept tested: Incident response and canary release rollback

Source: https://cloud.google.com/architecture/application-deployment-and-testing-strategies#canary_deployment

Topics

#Canary release#Incident response#Rollback#Service reliability

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-CLOUD-DEVOPS-ENGINEER Practice