Assessment of model risk in the aggregate: Contribution of quantification

Liming Brotcke and Raymond Brastow
Additional contact information
Liming Brotcke: Sr Director — Model Validation Risk — MRM, Ally, USA

Journal of Risk Management in Financial Institutions, 2018, vol. 12, issue 1, 16-43

Abstract: The ability to assess model risk in the aggregate is desirable, as it provides senior management with information on the overall risk associated with models used by the organisation. More importantly, it enables effective challenges and hence a robust measurement by connecting isolated information in a transparent way. This paper introduces a quantitative element to the assessment framework that utilises various model statistics from model development and performance monitoring periods. The paper links the model life cycle concept to risk quantification within families of similar models by introducing two risk measures: the Model Robustness Index (MRI) and the Model Stability Index (MSI). MRI is used to evaluate individual models’ robustness and goodness of fit. MSI employs key ongoing monitoring metrics and can be used along with judgmental factors as a dynamic measure of risk as model performance changes over time. Next, the paper introduces an approach to establish thresholds for ongoing performance monitoring. The paper demonstrates the value of these concepts by applying them to an example using binary logistic regression, that is, a simple application of a machine learning algorithm.

Keywords: model risk; model life cycle; risk aggregation; SR 11-7; model validation (search for similar items in EconPapers)
JEL-codes: E5 G2 (search for similar items in EconPapers)
Date: 2018
References: Add references at CitEc
Citations:

Downloads: (external link)
https://hstalks.com/article/5077/download/ (application/pdf)
https://hstalks.com/article/5077/ (text/html)
Requires a paid subscription for full access.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aza:rmfi00:y:2018:v:12:i:1:p:16-43

Access Statistics for this article

More articles in Journal of Risk Management in Financial Institutions from Henry Stewart Publications
Bibliographic data for series maintained by Henry Stewart Talks ().