LensReading which lens this session carries.

Connect · item 15

Data quality gates at intake

Bad data does not become less expensive further down the line. Sixteen checks sit at the first station of every line, covering completeness, validity, duplication, referential integrity, timeliness and consistency. A unit that fails is blocked outright or held in a quarantine queue with a named owner — never quietly waved through with a flag nobody reads.

Connector registry

Health

What the rules are catching

Active and monitoring rules, and everything they have held, released or rejected.

Gates at intake
16
14 enforcing · 2 monitoring only
Checks run
203,658
Across the whole estate at first station
Pass rate
99.6%
767 checks failed
Held right now
95
of 171 items ever quarantined
Held over 72 hours
62
Oldest is 9.1 days old
Rejected at intake
29
47 released after review

What happens on failure

The action is stated on the gate, not decided later.

Block4 gates
The unit never enters the line.
Quarantine8 gates
Held at intake for a named owner to clear.
Warn4 gates
Enters the line carrying a flag that travels with it.

Gates that have never fired

Reported as a zero, not as a pass.

1 of 16 gates have run without a single failure. That is either a genuinely clean condition or a check that is not reaching the data it was written for. It is listed here so somebody has to decide which.

The gates

Each names the dimension it tests, the expression it evaluates, what happens when it fails, and who owns the failures.

GateDimensionApplies toExpressionOn failureRunFailedPassHeldOwner
DQ-01
Mandatory header fields present
High
Completeness
Every unit at the first station of its line
all-lines
requester, value, materiality and jurisdiction are all non-empty at intake
Quarantine
threshold 99.5%
16,42067
99.6%
4N. Ferreira
DQ-12
Configuration item has a named owner
Medium
Completeness
Technology change and incident intake
function
Configuration Management Database
the configuration item referenced has an owning team recorded in the configuration database
Warn
threshold 95%
12,43665
99.5%
7J. Petrakis
DQ-15
Personal data fields carry a classification
Highmonitoring only
Completeness
Any unit whose payload may contain personal data
all-lines
each field flagged as person-linked carries a classification label before the unit enters the line
Quarantine
threshold 99%
14,39243
99.7%
2S. Bergqvist
DQ-16
Research payload provenance recorded
Mediummonitoring only
Completeness
Research and development intake
function
Research Notebook and Experiment Data
experiment payloads name their notebook entry and protocol version
Warn
threshold 95%
9,9280
100%
0P. Iyer

Quarantine queue

31 items match the current filter. Every held item has an owner and an age.

ItemFunction · lineGateFieldObservedExpectedSourceAgeStatusOwnerOutcome
HR3B-1033
Onboarding case at fast-track pack
DQ-01-Q-011
Human Resources
HR3B
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse8.8 daysHeldN. Ferreira
IT3B-1038
Device at ring test
DQ-12-Q-013
Information Technology
IT3B
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database8.6 daysReleasedJ. PetrakisCorrected at source and released back onto the line with the correction recorded.
IT3A-1008
Device at ship
DQ-12-Q-003
Information Technology
IT3A
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database8.3 daysHeldJ. Petrakis
IT1B-1018
Ticket at request
DQ-15-Q-002
Information Technology
IT1B
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse7.0 daysHeldS. Bergqvist
IT11A-1007
Cost line at publish
DQ-12-Q-011
Information Technology
IT11A
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database7.0 daysRejected at intakeJ. PetrakisRejected at intake. The unit never entered the line and the requester was told why.
IT5C-1010
Network change at install
DQ-12-Q-001
Information Technology
IT5C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database6.8 daysHeldJ. Petrakis
IT1C-1025
Ticket at reroute
DQ-12-Q-014
Information Technology
IT1C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database6.8 daysIn reviewJ. Petrakis
IT4C-1007
Infrastructure change at evidence
DQ-12-Q-012
Information Technology
IT4C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database6.5 daysHeldJ. Petrakis
MK2A-1026
Intelligence brief at assess impact
DQ-01-Q-003
Marketing
MK2A
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse6.0 daysHeldN. Ferreira
FI6A-1000
Cash action at propose position
DQ-15-Q-005
Finance
FI6A
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse5.8 daysRejected at intakeS. BergqvistRejected at intake. The unit never entered the line and the requester was told why.
MK5C-1018
Campaign send at detect defect
DQ-15-Q-001
Marketing
MK5C
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse5.7 daysReleasedS. BergqvistCorrected at source and released back onto the line with the correction recorded.
SC11B-1042
Risk event at mitigate
DQ-01-Q-006
Supply Chain
SC11B
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse5.6 daysReleasedN. FerreiraCorrected at source and released back onto the line with the correction recorded.
IT10C-1052
Change record at declare
DQ-12-Q-004
Information Technology
IT10C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database5.3 daysReleasedJ. PetrakisCorrected at source and released back onto the line with the correction recorded.
IT8C-1018
Pipeline run at request
DQ-12-Q-006
Information Technology
IT8C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database5.3 daysReleasedJ. PetrakisCorrected at source and released back onto the line with the correction recorded.
HR10A-1000
Listening cycle at re-identification check
DQ-01-Q-004
Human Resources
HR10A
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse5.0 daysRejected at intakeN. FerreiraRejected at intake. The unit never entered the line and the requester was told why.
LG9C-1026
Privacy case at regulator notify
DQ-01-Q-005
Legal
LG9C
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse4.7 daysReleasedN. FerreiraCorrected at source and released back onto the line with the correction recorded.
IT2A-1001
Access request at derive role
DQ-12-Q-002
Information Technology
IT2A
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database4.4 daysIn reviewJ. Petrakis
IT3B-1019
Device at detect patch
DQ-12-Q-005
Information Technology
IT3B
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database3.9 daysRejected at intakeJ. PetrakisRejected at intake. The unit never entered the line and the requester was told why.
IT3B-1004
Device at deploy
DQ-12-Q-009
Information Technology
IT3B
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database3.5 daysHeldJ. Petrakis
FI4C-1019
Close task at evidence
DQ-01-Q-010
Finance
FI4C
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse3.3 daysReleasedN. FerreiraCorrected at source and released back onto the line with the correction recorded.
CS9C-1024
Quality review at score independently
DQ-15-Q-004
Customer Service
CS9C
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse3.0 daysHeldS. Bergqvist
HR6B-1019
Learning path at evidence file
DQ-01-Q-008
Human Resources
HR6B
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse2.3 daysIn reviewN. Ferreira
IT8C-1029
Pipeline run at auto-review
DQ-12-Q-010
Information Technology
IT8C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database2.2 daysHeldJ. Petrakis
CS3A-1023
Escalated case at match known error
DQ-01-Q-007
Customer Service
CS3A
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse2.0 daysRejected at intakeN. FerreiraRejected at intake. The unit never entered the line and the requester was told why.
RD8A-1022
Submission at map requirements
DQ-01-Q-009
Research & Development
RD8A
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse46 hrReleasedN. FerreiraCorrected at source and released back onto the line with the correction recorded.
AD1B-1027
Work order at evidence capture
DQ-01-Q-001
Administration
AD1B
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse44 hrReleasedN. FerreiraCorrected at source and released back onto the line with the correction recorded.
IT5A-1025
Network change at auto-remediate known
DQ-12-Q-008
Information Technology
IT5A
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database30 hrReleasedJ. PetrakisCorrected at source and released back onto the line with the correction recorded.
SL2A-1012
Account plan at rep review
DQ-15-Q-003
Sales
SL2A
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse29 hrRejected at intakeS. BergqvistRejected at intake. The unit never entered the line and the requester was told why.
IT1C-1016
Ticket at track
DQ-12-Q-007
Information Technology
IT1C
DQ-12the configuration item referencedemptythe configuration item referenced has an owning team recorded in the configuration databaseConfiguration Management Database28 hrReleasedJ. PetrakisCorrected at source and released back onto the line with the correction recorded.
CS7B-1032
Claim at aggregate defects
DQ-01-Q-002
Customer Service
CS7B
DQ-01requester, value, materiality andemptyrequester, value, materiality and jurisdiction are all non-empty at intakeEnterprise Data Warehouse11 hrHeldN. Ferreira
GB9D-1006
Service review at challenge
DQ-15-Q-006
AI GBS & Global Business Services
GB9D
DQ-15each field flagged asemptyeach field flagged as person-linked carries a classification label before the unit enters the lineEnterprise Data Warehouse11 hrReleasedS. BergqvistCorrected at source and released back onto the line with the correction recorded.

Which lines carry the intake burden

Quarantine volume by function, all time.

Procurement & Source-to-Pay57
Information Technology26
Human Resources22
Supply Chain13
Marketing8
AI GBS & Global Business Services8
Finance7
Administration7
Legal5
Revenue Operations4
Sales4
Customer Service4
Engineering3
Research & Development3

Actions

What is waiting on a person

Quarantine is a holding pen, not a decision. Every item below is work that stopped and is waiting for somebody to say what happens to it.

Operations

What this desk is allowed to start

A surface that only reports is not operable. This is the work this page can set in motion, and the bound it runs into.

Trigger and bound

This desk can start a rule run across a named batch, and it can move an item into quarantine. It cannot release an item, reject one, or change a threshold — releasing bad data is the whole risk this layer exists to manage, so it stays with a person.

Live observability

What the record shows right now

What happened to everything the rules have held.

Current distribution

171 items

Released4727%
In review2816%
Quarantined6739%
Rejected2917%

Is policy and strategy coming to fruition

Whether the written intent is holding here

14 of 16 rules are enforcing. 95 items are held and undecided.

Not holding on the record

The written intent is that no unchecked record reaches a downstream figure. 14 rules enforce that today and 2 only watch. The queue is the real test: 67 items are held with nobody assigned and 28 are open with somebody assigned, against 47 released and 29 rejected historically. A held item is not a failure of the rule — it is the rule working — but a held item nobody judges is a figure quietly missing its input.

What this page is, and what it is not

The gates, the expressions, the thresholds and the quarantine queue are real mechanisms. They run at the first station of every line and they hold work that fails. What they run against is the modeled feed described on the connector registry — connect a customer instance and the same gates run unchanged against real intake.

2 of the 16 gates are set to monitor rather than enforce. They are counted in the check totals but they stop nothing. That is a deliberate state for a gate whose false-positive rate has not yet been characterized, and it is shown rather than hidden behind an overall pass rate.

62 items have been held for more than seventy-two hours, the oldest for 9.1 days. A quarantine queue that ages without clearing is a queue that people have learned to route around, so the age is shown on every row and never averaged away.