Validation of credit default probabilities using multiple-testing procedures

Sebastian Döhler

Journal of Risk Model Validation

Abstract: ABSTRACT We consider the problem of identifying inaccurate default probability estimates in credit rating systems. Since the validation of these estimates usually entails performing multiple tests, there is an increased risk of erroneously dismissing correctly calibrated default probabilities. We use multiple-testing procedures to control this risk of committing type-I errors as measured by the family-wise error rate (FWER) and the false discovery rate for finite sample sizes. For the FWER, we also consider procedures that take possible discreteness of the data (and the test statistics) into account. The performance of these methods is illustrated in a simulation setting and for empirical default data. The results show that both types of multiple-testing procedure can serve as helpful tools for identifying inaccurate estimates while maintaining a predefined level of type-I error.

References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.risk.net/journal-of-risk-model-validat ... e-testing-procedures (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rsk:journ5:2161263

Access Statistics for this article

More articles in Journal of Risk Model Validation from Journal of Risk Model Validation
Bibliographic data for series maintained by Thomas Paine ().