ROC and PRC Approaches to Evaluate Recession Forecasts

Kajal Lahiri and Cheng Yang

No 10449, CESifo Working Paper Series from CESifo

Abstract: We have studied the relationship between Receiver Operating Characteristics (ROC) and Precision-Recall Curve (PRC) both analytically and using a real-life empirical example of yield spread as a predictor of recessions. We show that false alarm rate in ROC and inverted precision in PRC are analogous concepts, and their difference is determined by the interaction of sample imbalance and forecast bias. We found that in cases of severe class imbalance, the forecasts need to be adequately biased to mitigate the effect of imbalancedness. The mix of values of precision and recall over six sub-samples show that the predictive power of the spread has not deteriorated in recent decades, provided the optimum values of threshold are used. Using PRC, we quantify the extent to which ROC could be exaggerating the true predictive value of the yield curve in predicting recessions.

Keywords: ROC; PRC; recessions; yield spread; rare events forecasting (search for similar items in EconPapers)
JEL-codes: C18 C22 C25 C53 E17 E37 E47 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.cesifo.org/DocDL/cesifo1_wp10449.pdf (application/pdf)

Related works:
Journal Article: ROC and PRC Approaches to Evaluate Recession Forecasts (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ces:ceswps:_10449

Access Statistics for this paper

More papers in CESifo Working Paper Series from CESifo Contact information at EDIRC.
Bibliographic data for series maintained by Klaus Wohlrabe (wohlrabe@ifo.de).