LensReading which lens this session carries.
Engineering/Site Reliability

Sub-function

Site Reliability

Owns incident work end to end inside Engineering. Runs 3 lines across 17 stations, drains the repeatable share into the AI-OPS tower, and holds 3 human gates.

orchestrator Reliability Orchestratorhuman owner Director, Site Reliability routes into ai-ops

Estate rating

A

78 / 100

autonomy 82%cap 87%

Correlation and runbook execution run in seconds without a human. A severity-one incident always gets a named human commander — the agent supports, it does not command.

Agents

9

Lines

3

Units / wk

16,109

Timetable vs actual

20.9h → 21.3h

Cost / unit

$6.59

was $24

Run-rate saving

$14.2M

annualized at this volume

The 9 agents running this sub-function

Grouped by what they are for, not by where they sit. The agent org is process-shaped.

OrchestratorOwns the queue and arbitrates between desks.

Reliability Orchestrator

Owns the site reliability lane end to end. Sequences the other agents, holds the timetable, and decides what surfaces to a human.

ObserveA37 / 24h88%6% ovr$4.74/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

AI GBSRuns the shared transaction spine.

Alert Correlation Agent

Runs the repeatable portion of site reliability inside the shared transaction spine at spine cost and spine controls.

AI GBSA41,166 / 24h95%5% ovr$0.47/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

Capacity Agent

Runs the repeatable portion of site reliability inside the shared transaction spine at spine cost and spine controls.

AI GBSA4817 / 24h95%9% ovr$0.30/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

TaskExecutes stations on a line.

Incident Commander Agent

Executes the site reliability step it owns, posts its evidence, and hands the unit to the next stage.

WorkflowA42,096 / 24h91%2% ovr$0.32/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

Runbook Execution Agent

Executes the site reliability step it owns, posts its evidence, and hands the unit to the next stage.

WorkflowA41,838 / 24h97%7% ovr$0.43/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

Post-mortem Agent

Executes the site reliability step it owns, posts its evidence, and hands the unit to the next stage.

WorkflowA42,468 / 24h94%5% ovr$0.56/task

ceiling A4 · escalates to Escalates to Director, Site Reliability when the unit falls outside the decision envelope or confidence drops below the floor.

PolicyAuthors and versions the binding rules.

Error Budget Agent

Holds the rules that bind every other agent in site reliability. Versions them, tests them against live decisions, and blocks work that breaches them.

PolicyA2210 / 24h87%11% ovr$4.77/task

ceiling A4 · escalates to Escalates on any decision that would breach a live policy version, with the clause cited.

Reliability Policy Agent

Holds the rules that bind every other agent in site reliability. Versions them, tests them against live decisions, and blocks work that breaches them.

PolicyA283 / 24h92%13% ovr$6.92/task

ceiling A4 · escalates to Escalates on any decision that would breach a live policy version, with the clause cited.

ChallengerPaid to disagree before a human has to.

Site Reliability Challenger Agent

Adversarial reviewer for site reliability. Argues the opposite case on every position and flags where the evidence does not carry the claim.

StrategyA2207 / 24h87%5% ovr$8.83/task

ceiling A4 · escalates to Escalates when a ratified position is still running against a break condition it flagged.

Estate rating breakdown

Seven control dimensions. Judgment readiness runs against autonomy on purpose.

Control Coverage78
Evidence Quality86
Override Discipline82
Data Integrity83
Recovery Readiness86
Cost Transparency82
Judgment Readiness48

People

What the humans stopped doing, and what they do now.

headcount on this work97.261.8 FTE

Redeployed into scenario work and strategy authoring review.

inference cost per unit$1.78

Lines running in this sub-function

Each line is a workflow. Click a line to walk it station by station.

10 clear5 evidenced1 held
EN7AIncident ResponseTransactional · 8 stations

Detect

1 live

Correlate alerts

3 live

Execute runbook

26 q

Escalate to human commander

2 q

Mitigate

1 live

Restore

30 q

Post-mortem

26 q

Actions tracked

2 live

EN7BError Budget EnforcementTransactional · 5 stations

Measure

2 live

Detect burn

32 q

Freeze releases

2 live

Notify

40 q

Restore

1 q

EN7CCapacity ResponseTransactional · 4 stations

Forecast

2 q

Scale in-policy

2 live

Escalate cost

2 live

Apply

1 live

Strategy positions this sub-function holds

An agent that only executes is a robot. These are the calls it made, the argument against each one, and what would prove it wrong.

EN7-POS-100

Site Reliability Operating Position

Ratifiedv1

Which parts of site reliability should deliberately stay human, and how do we defend that against a cost argument?

Hold the ceiling at A4 for site reliability. Correlation and runbook execution run in seconds without a human. A severity-one incident always gets a named human commander — the agent supports, it does not command. Raise it only after two consecutive quarters where the override rate stays under five percent and every override has a written cause.

confidence

77%

The challenge — Site Reliability Challenger Agent

Site Reliability Challenger Agent argues the recommendation leans on 4 quarters of data from a period with no volume shock. The confidence band overlaps the alternative, and the position does not say what it would take to be wrong. Recorded as a dissent, not a block.

Break conditions

  • ·Override rate rises above 14 percent for two consecutive months
  • ·Cost per incident stops falling while volume keeps rising
  • ·A control failure in this lane reaches a customer or a regulator

Evidence gaps

  • ·No external comparator on a like-for-like unit definition
  • ·Exception cases under $57k are sampled, not fully measured
Alternative consideredCostRiskVerdict
Hold the current position$722k run rateKnown and priced. Cedes ground if comparators move faster.not selected
Raise the ceiling one level now$474k to build controlsOverride rate is 12 percent; raising the ceiling before that settles imports the error into production.rejected on evidence
Move the exception tail to the spine$110k transitionLoses local context. Rework risk on the cases that are hardest to recover.selected
authored by Reliability Orchestratorratifier Director, Site Reliability3 stated assumptions
outcome did not hold

Ratified 5 months ago. Measured since: cost per incident rose 3 percent against a forecast that it would fall 24 percent.

Policy register

The rules the agents above are bound by. Version, owner, approver, and the agents each rule constrains.

RefRuleScopeOwner agentApproved byVersionStatus
EN7-POL-200

Site Reliability Decision Envelope

Agents in this lane may act without a human when the incident sits inside the stated value, risk and confidence envelope. Outside it, the unit holds at a gate with a named approver and a running clock.

binds 5 agents · APAC

envelopeError Budget AgentDirector, Site Reliabilityv1.6Active
EN7-POL-201

Site Reliability Evidence Standard

Every autonomous decision writes inputs, the rule version applied, the model and prompt version, the output and a reversal path. An action with no evidence record is treated as a control failure, not a fast decision.

binds 5 agents · Global · EU

evidenceError Budget AgentDirector, Site Reliabilityv4.7Active
EN7-POL-202

Site Reliability Escalation Rule

Escalation is mandatory when confidence falls below the floor, when two options sit inside the confidence band, or when a break condition on a ratified position fires. Director, Site Reliability owns the response clock.

binds 5 agents · Global · EU

escalationError Budget AgentDirector, Site Reliabilityv4.6Active