 Accuracy of explanations of machine learning models for credit decisionsAndres Alonso and
José Manuel Carbó
No 2222, Working Papers from Banco de España Abstract: One of the biggest challenges for the application of machine learning (ML) models in finance is how to explain their results. In recent years, innovative interpretability techniques have appeared to assist in this task, although their usefulness is still a matter of debate within the industry. In this article we propose a novel framework to assess how accurate these techniques are. Our work is based on the generation of synthetic datasets. This allows us to define the importance of the variables, so we can calculate to what extent the explanations given by these techniques match the ground truth of our data. We perform an empirical exercise in which we apply two non-interpretable ML models (XGBoost and Deep Learning) to the synthetic datasets, , and then we explain their results using two popular interpretability techniques, SHAP and permutation Feature Importance (FI). We conclude that generating synthetic datasets shows potential as a useful approach for supervisors and practitioners who wish to assess interpretability techniques. Keywords: synthetic datasets; artificial intelligence; interpretability; machine learning; credit assessment (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:bde:wpaper:2222 Access Statistics for this paper More papers in Working Papers from Banco de España Contact information at EDIRC. |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.