Data Governance and Modeling
Three regulatory reports, partially produced and reconciled by machine instead of by hand
The result
Regulatory reporting ran 40% faster across a live reporting cycle for three different reports with different frequencies.
Reports were assembled from a governed model with lineage behind every figure. Five months to the shipped solution, three parallel reporting cycles before cutover.
The challenge
Reports were assembled by hand, from source material arriving as documents, spreadsheets and connections into FP&A tools. The reports had different frequencies and data models.
A daily position-level report is filed every business day, two days after the as-of date. There is no human in the loop, so a control that is not automated does not exist.
The quarterly systemic indicators report had poorly defined owners. Parts of the report arrived as different teams emailed their own data.
The consolidated report was governed by the close calendar, and late manual adjustments (outside the pipeline) were not captured in the lineage. Historical reports and line items needed to be preserved and explained.
The solution
Decomposition worked backward, from the end reports to the source systems that fed them.
Scope was initially set to prove coverage. 180 items on the daily report: 60 each from the inflow, outflow and supplemental tables, selected so all thirteen product categories were sampled. 25 records per selected schedule on the consolidated report. 45 high-risk fields on the systemic indicators report.
A large share of those items had no formal system of record and no authorized distributor. No distributor means nobody is accountable for the quality of the figure. Naming report and data owners became a workstream of its own and had to be escalated to the project sponsor.
Three design decisions followed.
- Classification is held as dated mappings rather than hard-coded, so one figure can classify differently per report, and a figure filed two years ago can still be explained under the definitions then in force.
- Verification runs after each hop. It confirms the data arrived intact, but not why a figure is what it is.
- Stricter lineage to prove where the figure came from, and every calculation applied along the way. The question that actually arrives is why a figure moved since last quarter when the business did not change, and the answer is almost always a rule change or a manual adjustment.
One requirement came from Finance rather than from us. They needed the ability to override an individual figure, built on day one with a mandatory reason and a named approver.
The outcome
Report creation itself did not yield the biggest time saving, because of legacy system constraints. End to end, from creation through reconciliation and publication, the cycle ran roughly 40% quicker, thanks to a reduction in manual effort. That saving recurs every cycle rather than once at build time.
In addition to the operational efficiencies, risks related to manual adjustments and gaps in lineage decreased.
Reporting that cannot explain itself?
Governance and modeling engagements begin with one figure nobody can trace.
