← All posts

SRE · 9 min read

SRE Beyond Green Dashboards: Reliability Customers Can Feel

Uptime percentages flatter. Error budgets, dependency maps, and honest incident reviews are how Asian product teams keep promises under real load.

SREreliabilityerror budgetsincidents

A dashboard can be green while checkout fails for a segment of users on one payment rail. Reliability is not a single percentage. It is a set of promises about how a product behaves when parts of the world misbehave. Customers feel journeys. They do not feel your cluster CPU. Site reliability engineering brings product thinking to operations: define SLOs that match user journeys, spend error budgets deliberately, and treat toil as work to eliminate rather than a badge of honor. Heroic nights do not scale. Designed recovery does.

Error budgets change conversations

Without budgets, every incident becomes a blame session and every feature becomes non-negotiable. With budgets, product and engineering negotiate. A ride-hailing team in Jakarta set an availability SLO on completed trips, not on raw API uptime. When a maps dependency degraded, they had language for freezing non-critical releases until recovery work landed.

That freeze annoyed some stakeholders. It also prevented a second incident caused by shipping UI polish into a fragile moment. The budget made the trade-off visible. Visibility is what keeps reliability from becoming a private ops concern that product discovers on social media.

Dependencies are the real topology

Most outages are not "our server died." They are a queue filling, a certificate expiring, a regional cloud control plane hiccup, or a third-party SMS gateway timing out. Map critical user journeys to dependencies. Practice failures on purpose where you can. Surprises belong in drills, not in peak hour.

Caution: paging on every CPU blip trains on-call engineers to ignore alerts. Alert on symptoms that users feel, and keep runbooks next to the alert, not in a forgotten Confluence graveyard. If the runbook is older than the service topology, the alert is incomplete.

Practices that travel well

  • Write SLOs around journeys: login, search, pay, sync.
  • Run blameless reviews with action items that have owners and dates.
  • Track toil hours; automate the top offenders quarterly.
  • Rehearse communication templates for customer-facing incidents before you need them.
  • Review dependency ownership when vendors change account managers, because knowledge walks out with people.

Culture, vendors, and customer language

Reliability culture shows up in how leaders react to freezes. If pausing a release during an error-budget burn is treated as engineering stubbornness, you do not have SRE. You have monitoring cosplay. Executives should hear reliability trade-offs in customer language: completed trips, successful payouts, synced orders. Translate the SLO into that language and the freeze becomes a business decision instead of a tribal fight.

Vendor dependencies deserve explicit owners. When a payment rail or SMS gateway degrades, someone must know the escalation path at 2 a.m. without searching Slack history. Write that path into the runbook and test it. The green dashboard that ignores a dying dependency is a lullaby. Customers hear the silence as brokenness, and they are right. Operators who have lived through a messy quarter learn to prefer controls that are visible, owned, and reversible. Invisible controls fail silently. Unowned controls fail politically. Irreversible controls fail catastrophically when the first wrong assumption meets real traffic. Build for the messy quarter on purpose. Across APAC markets, the constraint is rarely a lack of tools. It is a lack of sequenced decisions that survive contact with procurement, language reality, and peak-season load. Sequence the decisions. Publish the owners. Revisit the sequence when the metrics stall instead of buying another overlapping category. A useful internal test is whether a skeptical finance partner can understand the unit economics without a translator from engineering slang. If the story only works in a specialist room, it is not ready for production funding. Translate early. Funding follows comprehension more often than it follows novelty.

Takeaway

SRE succeeds when reliability work is visible in product trade-offs, not only in ops tooling. Green graphs are nice. Kept promises are better. If your uptime slide is green while customers cannot complete the journey you sell, rewrite the slide and the SLO until they match the same reality.

More from the desk