The Population Accuracy Index: A New Measure of Population Stability for Model Monitoring

Ross Taplin and Clive Hunt
Additional contact information
Ross Taplin: School of Accounting, Curtin Business School, Curtin University, Bentley, WA 6102, Australia
Clive Hunt: Private Practice, Perth, WA 6009, Australia

Risks, 2019, vol. 7, issue 2, 1-11

Abstract: Risk models developed on one dataset are often applied to new data and, in such cases, it is prudent to check that the model is suitable for the new data. An important application is in the banking industry, where statistical models are applied to loans to determine provisions and capital requirements. These models are developed on historical data, and regulations require their monitoring to ensure they remain valid on current portfolios—often years since the models were developed. The Population Stability Index (PSI) is an industry standard to measure whether the distribution of the current data has shifted significantly from the distribution of data used to develop the model. This paper explores several disadvantages of the PSI and proposes the Prediction Accuracy Index (PAI) as an alternative. The superior properties and interpretation of the PAI are discussed and it is concluded that the PAI can more accurately summarise the level of population stability, helping risk analysts and managers determine whether the model remains fit-for-purpose.

Keywords: population stability index (PSI); Basel Accord; IFRS 9; model monitoring; model validation (search for similar items in EconPapers)
JEL-codes: C G0 G1 G2 G3 K2 M2 M4 (search for similar items in EconPapers)
Date: 2019
References: View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/2227-9091/7/2/53/pdf (application/pdf)
https://www.mdpi.com/2227-9091/7/2/53/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jrisks:v:7:y:2019:i:2:p:53-:d:228501

Access Statistics for this article

Risks is currently edited by Mr. Claude Zhang

More articles in Risks from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().