Forecast accuracy measures for exception reporting using receiver operating characteristic curves

Wilpen L. Gorr

International Journal of Forecasting, 2009, vol. 25, issue 1, 48-61

Abstract: The exception principle of management reporting suggests that, under ordinary conditions, operational staff persons make decisions, but that the same staff refer decisions to upper-level managers under exceptional conditions. Forecasts of large changes or extreme values in product or service demand are potential triggers for such reporting. Seasonality estimates in univariate forecast models and leading independent variables in multivariate forecast models are among the approaches to forecasting exceptional demand, a forecast activity that this paper identifies as requiring new accuracy measures based on the tails of sampled forecast error distributions, rather than conventional measures which use the central tendency. For this purpose, the paper introduces the application of the receiver operating characteristic (ROC) framework, which has been used for the assessment of exceptional behavior in many fields. In a case study on serious violent crime in Pittsburgh, Pennsylvania, the simplest, non-naïve univariate forecast method is best for forecasting ordinary conditions using conventional forecast accuracy measures, but the most complex multivariate model is best for forecasting exceptional conditions using ROC forecast accuracy measures.

Keywords: Forecast; accuracy; measures; Exception; reporting; ROC; curves; Crime; forecasting (search for similar items in EconPapers)
Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (13)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0169-2070(08)00144-1
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:intfor:v:25:y:2009:i:1:p:48-61

Access Statistics for this article

International Journal of Forecasting is currently edited by R. J. Hyndman

More articles in International Journal of Forecasting from Elsevier
Bibliographic data for series maintained by Catherine Liu ().