Data quality challenges in granular databases on financial transactions
Conference
65th ISI World Statistics Congress 2025
Format: IPS Abstract - WSC 2025
Keywords: data, financial, granular, quality
Session: IPS 968 - Digitalisation in Financial Markets and New Horizons for Data and Reporting
Wednesday 8 October 10:50 a.m. - 12:30 p.m. (Europe/Amsterdam)
Abstract
The ECB data quality processes for granular data on financial transactions would be analysed in a three-step approach. First, how to detect and correct wrongly reported data by comparing individual observations with transactions in the same dataset being reported by the same or different reporting agents. This first step would cover daily processes to ensure correctness and completeness of reporting, including anomaly detection and management of revisions. Second, how to check and correct data by pairing a transaction with the opposite transaction reported by the counterparty under the same data set. Here also the challenges and benefits of the Unique Transaction Identifier (UTI) would be discussed. Third, how to compare and analyse micro data from two different data sets in order to identify inconsistencies and ensure quality. Experience with the ECB Money Market Statistical Reporting (MMSR) and European Market Infrastructure Regulation (EMIR) datasets, also in relation to the European Securities Financing Transactions Regulation (SFTR) would be described.