A decision-making rule to detect insufficient data quality: an application of statistical learning techniques to the non-performing loans banking data?

Paolo Cimbali, Marco De Leonardis, Alessio Fiume, Barbara La Ganga (), Luciana Meoli () and Marco Orlandi ()

No 666, Questioni di Economia e Finanza (Occasional Papers) from Bank of Italy, Economic Research and International Relations Area

Abstract: The paper presents a decision-making rule, based on statistical learning techniques, to evaluate and monitor the overall quality of the granular dataset referring to the Non-Performing Loans data collection carried out by the Bank of Italy. The datasets submitted by the reporting agents must display a sufficiently high level of quality before their release to users. The study defines a decision-making rule to distinguish the cases where the corrections applied to the original dataset improve its overall quality from those where the revisions (unexpectedly) make it worse. The decision-making rule is based on a new synthetic data quality indicator, based on past evidence accumulated on data quality management activity, which makes possible the assessment and monitoring of the overall quality of the Non-Performing Loans dataset. The proposed indicator takes into account different metrics that influence the overall quality of the dataset, specifically the number of remarks (potential outliers) detected by the Bank of Italy’s internal procedures, their degree of severity and the expected number of confirmations of underlying data, the latter based on the estimation provided by the logistic regression model.

Keywords: potential outliers; non-performing loans; data quality; supervised machine learning; logistic regression (search for similar items in EconPapers)
JEL-codes: C18 C81 G21 (search for similar items in EconPapers)
Date: 2022-02
New Economics Papers: this item is included in nep-cmp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.bancaditalia.it/pubblicazioni/qef/2022-0666/QEF_666_22.pdf (application/pdf)

Related works:
Chapter: A decision-making rule to detect insufficient data quality - an application of statistical learning techniques to the non-performing loans banking data (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bdi:opques:qef_666_22

Access Statistics for this paper

More papers in Questioni di Economia e Finanza (Occasional Papers) from Bank of Italy, Economic Research and International Relations Area Contact information at EDIRC.
Bibliographic data for series maintained by ().