The validation of machine-learning models for the stress testing of credit risk

Michael Jacobs, Jr

Journal of Risk Management in Financial Institutions, 2018, vol. 11, issue 3, 218-243

Abstract: Banking supervisors need to know the amount of capital resources required by an institution to support the risks taken. Traditional approaches, such as regulatory capital ratios, have proven inadequate, giving rise to stress-testing as a primary tool. The macroeconomic variables that supervisors provide to institutions for exercises such as the Comprehensive Capital Analysis and Review (CCAR) programme represent a critical input into this. A common approach to segment-level modelling is statistical regression, like vector autoregression (VAR), to exploit the dependency structure between macroeconomic drivers and modelling segments. However, linear models such as VAR are unable to model distributions that deviate from normality. This paper proposes a challenger approach in the machine-learning class of models, widely used in the academic literature, but not commonly employed in practice: the multivariate adaptive regression splines (MARS) model. The study empirically tests these models using Fed Y-9 filings and macroeconomic data, released by the regulators for CCAR purposes. The champion MARS model is validated through a rigorous comparison against the VAR model, and is found to exhibit greater accuracy and superior out-of-sample performance, according to various metrics across all modelling segments. The MARS model also produces more reasonable forecasts according to quality and conservatism.

Keywords: stress testing; CCAR; DFAST; credit risk; financial crisis; model risk; vector autoregression; multivariate adaptive regression splines; model validation (search for similar items in EconPapers)
JEL-codes: E5 G2 (search for similar items in EconPapers)
Date: 2018
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://hstalks.com/article/3331/download/ (application/pdf)
https://hstalks.com/article/3331/ (text/html)
Requires a paid subscription for full access.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aza:rmfi00:y:2018:v:11:i:3:p:218-243

Access Statistics for this article

More articles in Journal of Risk Management in Financial Institutions from Henry Stewart Publications
Bibliographic data for series maintained by Henry Stewart Talks ().