Measuring the Discriminative Power of Rating Systems

Bernd Engelmann, Evelyn Hayden and Dirk Tasche

No 2003,01, Discussion Paper Series 2: Banking and Financial Studies from Deutsche Bundesbank

Abstract: Assessing the discriminative power of rating systems is an important question to banks and to regulators. In this article we analyze the Cumulative Accuracy Profile (CAP) and the Receiver Operating Characteristic (ROC) which are both commonly used in practice. We give a test-theoretic interpretation for the concavity of the CAP and the ROC curve and demonstrate how this observation can be used for more efficiently exploiting the informational contents of accounting ratios. Furthermore, we show that two popular summary statistics of these concepts, namely the Accuracy Ratio and the area under the ROC curve, contain the same information and we analyse the statistical properties of these measures. We show in detail how to identify accounting ratios with high discriminative power, how to calculate confidence intervals for the area below the ROC curve, and how to test if two rating models validated on the same data set are different. All concepts are illustrated by applications to real data.

Keywords: Validation; Rating Models; Credit Analysis (search for similar items in EconPapers)
JEL-codes: C52 G10 (search for similar items in EconPapers)
Date: 2003
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (37)

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/19726/1/200301dkp_b.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:bubdp2:2225

Access Statistics for this paper

More papers in Discussion Paper Series 2: Banking and Financial Studies from Deutsche Bundesbank Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().