LensReading which lens this session carries.

Connect · item 15

Data quality gates at intake

Bad data does not become less expensive further down the line. Sixteen checks sit at the first station of every line, covering completeness, validity, duplication, referential integrity, timeliness and consistency. A unit that fails is blocked outright or held in a quarantine queue with a named owner — never quietly waved through with a flag nobody reads.

Connector registry

Health

What the rules are catching

Active and monitoring rules, and everything they have held, released or rejected.

Gates at intake
16
14 enforcing · 2 monitoring only
Checks run
203,658
Across the whole estate at first station
Pass rate
99.6%
767 checks failed
Held right now
95
of 171 items ever quarantined
Held over 72 hours
62
Oldest is 9.1 days old
Rejected at intake
29
47 released after review

What happens on failure

The action is stated on the gate, not decided later.

Block4 gates
The unit never enters the line.
Quarantine8 gates
Held at intake for a named owner to clear.
Warn4 gates
Enters the line carrying a flag that travels with it.

Gates that have never fired

Reported as a zero, not as a pass.

1 of 16 gates have run without a single failure. That is either a genuinely clean condition or a check that is not reaching the data it was written for. It is listed here so somebody has to decide which.

The gates

Each names the dimension it tests, the expression it evaluates, what happens when it fails, and who owns the failures.

GateDimensionApplies toExpressionOn failureRunFailedPassHeldOwner
DQ-01
Mandatory header fields present
High
Completeness
Every unit at the first station of its line
all-lines
requester, value, materiality and jurisdiction are all non-empty at intake
Quarantine
threshold 99.5%
16,42067
99.6%
4N. Ferreira
DQ-02
Supplier exists and is not blocked
Critical
Referential
Source-to-pay intake
function
Source-to-Pay Suite
supplier identifier resolves to an active, non-blocked record in the source-to-pay suite
Block
threshold 100%
8,37944
99.5%
9K. Boateng
DQ-03
Invoice not already presented
Critical
Duplication
Invoice capture intake
function
Invoice Capture and AP Automation
supplier plus invoice number plus gross amount has not been seen in the trailing 400 days
Block
threshold 100%
6,92444
99.4%
13M. Okonjo
DQ-04
Amount is a parseable figure in a known currency
High
Validity
Any unit carrying a value
all-lines
Group ERP — Financials
value parses to a positive decimal and the currency code appears in the group currency table
Quarantine
threshold 99.9%
22,08966
99.7%
6D. Halvorsen
DQ-05
Cost center is open in the period
High
Referential
Anything that will post to the ledger
all-lines
Planning and Consolidation
cost center exists in planning and is open for the posting period
Quarantine
threshold 99.5%
15,03662
99.6%
6D. Halvorsen
DQ-06
Purchase order is open and has remaining value
Critical
Referential
Three-way match intake
function
Group ERP — Materials and Inventory
referenced purchase order exists in materials management, is open, and remaining value covers the invoice
Quarantine
threshold 99%
19,227100
99.5%
8K. Boateng
DQ-07
Tax code valid for the jurisdiction pair
High
Validity
Cross-border invoice and order intake
all-lines
Indirect Tax Engine
tax code returned by the engine is valid for the ship-from and ship-to jurisdiction pair on the date of supply
Quarantine
threshold 99%
3,1239
99.7%
5F. Aubert
DQ-08
Worker record active at the effective date
Critical
Referential
Hire-to-retire intake
function
Core HR and Payroll
the worker referenced holds an active record in core human resources on the effective date of the change
Block
threshold 100%
18,37975
99.6%
7S. Bergqvist
DQ-09
No conflicting open unit for the same subject
Medium
Duplication
Every line
all-lines
no other open unit on the same line carries the same subject identifier
Warn
threshold 98%
10,48243
99.6%
8N. Ferreira
DQ-10
Source extract inside its freshness commitment
High
Timeliness
Any unit relying on an inbound feed
all-lines
every source system the unit reads has synchronized within its committed freshness window
Warn
threshold 97%
94515
98.4%
8N. Ferreira
DQ-11
Contract reference resolves to an executed agreement
High
Referential
Legal, procurement and sales intake
all-lines
Contract Lifecycle Management
the contract identifier resolves to an executed, in-term agreement in contract lifecycle management
Quarantine
threshold 99%
13,08239
99.7%
5V. Marchetti
DQ-12
Configuration item has a named owner
Medium
Completeness
Technology change and incident intake
function
Configuration Management Database
the configuration item referenced has an owning team recorded in the configuration database
Warn
threshold 95%
12,43665
99.5%
7J. Petrakis
DQ-13
Bank detail change carries out-of-band confirmation
Critical
Validity
Supplier master change intake
function
Source-to-Pay Suite
any change to supplier bank detail is accompanied by an out-of-band confirmation reference
Block
threshold 100%
17,59833
99.8%
1L. Duarte
DQ-14
Quantities agree between order and receipt
Medium
Consistency
Goods receipt intake
function
Group ERP — Materials and Inventory
received quantity is within the agreed variance of ordered quantity for the material and supplier
Quarantine
threshold 98%
15,21862
99.6%
6R. Nakamura
DQ-15
Personal data fields carry a classification
Highmonitoring only
Completeness
Any unit whose payload may contain personal data
all-lines
each field flagged as person-linked carries a classification label before the unit enters the line
Quarantine
threshold 99%
14,39243
99.7%
2S. Bergqvist
DQ-16
Research payload provenance recorded
Mediummonitoring only
Completeness
Research and development intake
function
Research Notebook and Experiment Data
experiment payloads name their notebook entry and protocol version
Warn
threshold 95%
9,9280
100%
0P. Iyer

Quarantine queue

2 items match the current filter. Every held item has an owner and an age.

ItemFunction · lineGateFieldObservedExpectedSourceAgeStatusOwnerOutcome
PR7C-1019
Supplier review at transition plan
DQ-06-Q-001
Procurement & Source-to-Pay
PR7C
DQ-06referenced purchase order existsno matching recordreferenced purchase order exists in materials management, is open, and remaining value covers the invoiceGroup ERP — Materials and Inventory7.7 daysRejected at intakeK. BoatengRejected at intake. The unit never entered the line and the requester was told why.
PR2C-1021
Spend line at size opportunities
DQ-06-Q-005
Procurement & Source-to-Pay
PR2C
DQ-06referenced purchase order existsno matching recordreferenced purchase order exists in materials management, is open, and remaining value covers the invoiceGroup ERP — Materials and Inventory2.8 daysRejected at intakeK. BoatengRejected at intake. The unit never entered the line and the requester was told why.

Which lines carry the intake burden

Quarantine volume by function, all time.

Procurement & Source-to-Pay57
Information Technology26
Human Resources22
Supply Chain13
Marketing8
AI GBS & Global Business Services8
Finance7
Administration7
Legal5
Revenue Operations4
Sales4
Customer Service4
Engineering3
Research & Development3

Actions

What is waiting on a person

Quarantine is a holding pen, not a decision. Every item below is work that stopped and is waiting for somebody to say what happens to it.

Operations

What this desk is allowed to start

A surface that only reports is not operable. This is the work this page can set in motion, and the bound it runs into.

Trigger and bound

This desk can start a rule run across a named batch, and it can move an item into quarantine. It cannot release an item, reject one, or change a threshold — releasing bad data is the whole risk this layer exists to manage, so it stays with a person.

Live observability

What the record shows right now

What happened to everything the rules have held.

Current distribution

171 items

Released4727%
In review2816%
Quarantined6739%
Rejected2917%

Is policy and strategy coming to fruition

Whether the written intent is holding here

14 of 16 rules are enforcing. 95 items are held and undecided.

Not holding on the record

The written intent is that no unchecked record reaches a downstream figure. 14 rules enforce that today and 2 only watch. The queue is the real test: 67 items are held with nobody assigned and 28 are open with somebody assigned, against 47 released and 29 rejected historically. A held item is not a failure of the rule — it is the rule working — but a held item nobody judges is a figure quietly missing its input.

What this page is, and what it is not

The gates, the expressions, the thresholds and the quarantine queue are real mechanisms. They run at the first station of every line and they hold work that fails. What they run against is the modeled feed described on the connector registry — connect a customer instance and the same gates run unchanged against real intake.

2 of the 16 gates are set to monitor rather than enforce. They are counted in the check totals but they stop nothing. That is a deliberate state for a gate whose false-positive rate has not yet been characterized, and it is shown rather than hidden behind an overall pass rate.

62 items have been held for more than seventy-two hours, the oldest for 9.1 days. A quarantine queue that ages without clearing is a queue that people have learned to route around, so the age is shown on every row and never averaged away.