LensReading which lens this session carries.

Revenue Growth Management · renewals-and-churn-ops Renewals & Churn Ops

Renewals & Churn Ops Challenger Agent

challenger agent in the strategy layer, owned by Nadia Kovac (Independent Evaluation Lead).

All agents

The ladder

Where this agent sits, how far it is allowed to go and what the next rung would cost.

Propose
Passed.
Shadow
Passed.
SupervisedHERE
Human in the loop: Every output, before release
Delegated
Entry needs 5 artifacts.
AutonomousCEILING
Entry needs 5 artifacts.
Evidence held

Nothing on file. This agent was already running when the gate went live on Mar 3, 2026.

Missing for delegated
  • ·Golden test set defined and the first evaluation run recorded
  • ·Override capture wired so every human correction is stored as a case
  • ·Human queue capacity confirmed against forecast volume
  • ·Rollback path written down and owned

This agent was already running at this stage when the lifecycle gate was introduced.

Return rule for this agent

Override rate above 25 percent over 14 days, or a failed evaluation run against the held-out set, returns the agent to shadow automatically.

Wired to a live threshold. It fires and moves the agent down without anyone deciding to.

Known gap

Running at a stage it reached before the gate existed.

Transition history

Each entry names who decided, what they held and whether a rule or a person made the call.

0 on record

No transitions recorded. This agent predates the gate, which went live on Mar 3, 2026. It reached its current stage before anyone was keeping a record, and that absence is why it is frozen rather than shown as compliant.

Evaluation record

The golden set this agent is measured against, and every run scored against it.

No golden set

Nothing has been written that this agent can be tested against.

What this record is, and what it is not

Every evaluation on this page ran against golden sets we wrote ourselves, on a modeled estate.

This agent has no golden set, so there is nothing here to score. The record shows an absence rather than a pass, which is the honest reading: an untested agent is not a safe agent that has not been checked yet, it is an agent whose behavior nobody has established.