LensReading which lens this session carries.
Engineering/Engineering Analytics

Sub-function

Engineering Analytics

Owns analysis work end to end inside Engineering. Runs 3 lines across 15 stations, drains the repeatable share into the DATA-ANALYTICS tower, and holds 3 human gates.

orchestrator Engineering Analytics Orchestratorhuman owner Director, Engineering Analytics routes into data-analytics

Estate rating

BBB

74 / 100

autonomy 63%cap 88%

Metric assembly and trend detection are fully agentic. Team-level metrics are deliberately never used for individual performance without a human interpreting context.

Agents

8

Lines

3

Units / wk

139

Timetable vs actual

7.1d → 7.6d

Cost / unit

$441

was $2K

Run-rate saving

$7.7M

annualized at this volume

The 8 agents running this sub-function

Grouped by what they are for, not by where they sit. The agent org is process-shaped.

OrchestratorOwns the queue and arbitrates between desks.

Engineering Analytics Orchestrator

Owns the engineering analytics lane end to end. Sequences the other agents, holds the timetable, and decides what surfaces to a human.

ObserveA328 / 24h91%5% ovr$7.87/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

AI GBSRuns the shared transaction spine.

Delivery Metrics Agent

Runs the repeatable portion of engineering analytics inside the shared transaction spine at spine cost and spine controls.

AI GBSA43,566 / 24h96%4% ovr$0.49/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

Reliability Trend Agent

Runs the repeatable portion of engineering analytics inside the shared transaction spine at spine cost and spine controls.

AI GBSA43,104 / 24h99%2% ovr$0.60/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

TaskExecutes stations on a line.

Cycle Time Agent

Executes the engineering analytics step it owns, posts its evidence, and hands the unit to the next stage.

WorkflowA42,690 / 24h95%7% ovr$0.58/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

Cost per Service Agent

Executes the engineering analytics step it owns, posts its evidence, and hands the unit to the next stage.

WorkflowA42,693 / 24h92%7% ovr$0.42/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

ObserveWatches signals and watches the agents.

Team Health Agent

Watches engineering analytics continuously. Detects drift, quantifies it, and routes what matters without waiting for a reporting cycle.

ObserveA4149 / 24h96%17% ovr$12/task

ceiling A4 · escalates to Escalates to Director, Engineering Analytics when the unit falls outside the decision envelope or confidence drops below the floor.

StrategyForms and defends a position.

Measurement Doctrine Agent

Authors positions on engineering analytics. Frames the question, models the options, and writes a recommendation a human can ratify or reject.

StrategyA260 / 24h89%14% ovr$3.66/task

ceiling A4 · escalates to Escalates when two options sit inside the confidence band and the evidence cannot separate them.

ChallengerPaid to disagree before a human has to.

Engineering Analytics Challenger Agent

Adversarial reviewer for engineering analytics. Argues the opposite case on every position and flags where the evidence does not carry the claim.

StrategyA2181 / 24h89%4% ovr$11/task

ceiling A4 · escalates to Escalates when a ratified position is still running against a break condition it flagged.

Estate rating breakdown

Seven control dimensions. Judgment readiness runs against autonomy on purpose.

Control Coverage81
Evidence Quality80
Override Discipline76
Data Integrity73
Recovery Readiness73
Cost Transparency79
Judgment Readiness52

People

What the humans stopped doing, and what they do now.

headcount on this work10.76.7 FTE

Redeployed into customer-facing escalation ownership.

inference cost per unit$125

Lines running in this sub-function

Each line is a workflow. Click a line to walk it station by station.

3 clear1 evidenced4 held
EN11AMonthly Engineering ReadAnalytical · 6 stations

Ingest

2 live

Model delivery metrics

5 q

Detect trend

1 live

Draft readout

11 q

CTO review

1 live

Publish

45 q

EN11BCost per Service ReadAnalytical · 4 stations

Attribute cloud spend

24 q

Rank

15 q

Draft recommendation

1 q

Owner review

2 live

EN11CMeasurement Doctrine PositionJudgment · 5 stations

Frame

15 q

Model options

7 q

Draft position

5 q

Challenge

1 live

Ratify

1 live

Strategy positions this sub-function holds

An agent that only executes is a robot. These are the calls it made, the argument against each one, and what would prove it wrong.

EN11-POS-100

Measurement Doctrine Position

Ratifiedv3

Is the current cost per analysis defensible against external comparators once inference spend is counted in full?

Hold the ceiling at A4 for engineering analytics. Metric assembly and trend detection are fully agentic. Team-level metrics are deliberately never used for individual performance without a human interpreting context. Raise it only after two consecutive quarters where the override rate stays under five percent and every override has a written cause.

confidence

86%

The challenge — Engineering Analytics Challenger Agent

Engineering Analytics Challenger Agent argues the recommendation leans on 2 quarters of data from a period with no volume shock. The confidence band overlaps the alternative, and the position does not say what it would take to be wrong. Recorded as a dissent, not a block.

Break conditions

  • ·Override rate rises above 15 percent for two consecutive months
  • ·Cost per analysis stops falling while volume keeps rising
  • ·A control failure in this lane reaches a customer or a regulator

Evidence gaps

  • ·No external comparator on a like-for-like unit definition
  • ·Exception cases under $19k are sampled, not fully measured
Alternative consideredCostRiskVerdict
Hold the current position$663k run rateKnown and priced. Cedes ground if comparators move faster.not selected
Raise the ceiling one level now$794k to build controlsOverride rate is 4 percent; raising the ceiling before that settles imports the error into production.rejected on evidence
Move the exception tail to the spine$126k transitionLoses local context. Rework risk on the cases that are hardest to recover.selected
authored by Measurement Doctrine Agentratifier Director, Engineering Analytics3 stated assumptions
outcome did not hold

Ratified 3 months ago. Measured since: cost per analysis rose 3 percent against a forecast that it would fall 9 percent.

EN11-POS-101

Engineering Analytics Operating Position

In challengev3

Which parts of engineering analytics should deliberately stay human, and how do we defend that against a cost argument?

Keep the repeatable analysis volume in the spine and pull the exception tail back into the function. The spine is cheaper per unit; the tail is where the context that prevents rework actually sits.

confidence

65%

The challenge — Engineering Analytics Challenger Agent

Engineering Analytics Challenger Agent argues the recommendation leans on 3 quarters of data from a period with no volume shock. The confidence band overlaps the alternative, and the position does not say what it would take to be wrong. Recorded as a dissent, not a block.

Break conditions

  • ·Override rate rises above 6 percent for two consecutive months
  • ·Cost per analysis stops falling while volume keeps rising
  • ·A comparator publishes a materially lower unit cost on a like-for-like basis

Evidence gaps

  • ·No external comparator on a like-for-like unit definition
  • ·Exception cases under $28k are sampled, not fully measured
Alternative consideredCostRiskVerdict
Hold the current position$312k run rateKnown and priced. Cedes ground if comparators move faster.live
Raise the ceiling one level now$917k to build controlsOverride rate is 8 percent; raising the ceiling before that settles imports the error into production.rejected on evidence
Move the exception tail to the spine$520k transitionLoses local context. Rework risk on the cases that are hardest to recover.under review
authored by Measurement Doctrine Agentratifier Director, Engineering Analytics3 stated assumptions

Policy register

The rules the agents above are bound by. Version, owner, approver, and the agents each rule constrains.

RefRuleScopeOwner agentApproved byVersionStatus
EN11-POL-200

Engineering Analytics Decision Envelope

Agents in this lane may act without a human when the analysis sits inside the stated value, risk and confidence envelope. Outside it, the unit holds at a gate with a named approver and a running clock.

binds 4 agents · Global

envelopeEngineering Analytics OrchestratorDirector, Engineering Analyticsv1.4Active
EN11-POL-201

Engineering Analytics Evidence Standard

Every autonomous decision writes inputs, the rule version applied, the model and prompt version, the output and a reversal path. An action with no evidence record is treated as a control failure, not a fast decision.

binds 4 agents · US · Canada

evidenceEngineering Analytics OrchestratorDirector, Engineering Analyticsv3.4under review
EN11-POL-202

Engineering Analytics Escalation Rule

Escalation is mandatory when confidence falls below the floor, when two options sit inside the confidence band, or when a break condition on a ratified position fires. Director, Engineering Analytics owns the response clock.

binds 4 agents · APAC

escalationEngineering Analytics OrchestratorDirector, Engineering Analyticsv4.3Active
EN11-POL-203

Engineering Analytics Autonomy Ceiling

The ceiling for this lane is 88 on the platform scale. Metric assembly and trend detection are fully agentic. Team-level metrics are deliberately never used for individual performance without a human interpreting context. The ceiling is a governance decision, not a technical limit, and only Director, Engineering Analytics can propose moving it.

binds 4 agents · Global

ceilingEngineering Analytics OrchestratorDirector, Engineering Analyticsv5.6Active