Forecast accuracy measures for exception reporting using receiver operating characteristic curves

Wilpen L. Gorr

International Journal of Forecasting, 2009, vol. 25, issue 1, pages 48-61

Abstract: The exception principle of management reporting suggests that, under ordinary conditions, operational staff persons make decisions, but that the same staff refer decisions to upper-level managers under exceptional conditions. Forecasts of large changes or extreme values in product or service demand are potential triggers for such reporting. Seasonality estimates in univariate forecast models and leading independent variables in multivariate forecast models are among the approaches to forecasting exceptional demand, a forecast activity that this paper identifies as requiring new accuracy measures based on the tails of sampled forecast error distributions, rather than conventional measures which use the central tendency. For this purpose, the paper introduces the application of the receiver operating characteristic (ROC) framework, which has been used for the assessment of exceptional behavior in many fields. In a case study on serious violent crime in Pittsburgh, Pennsylvania, the simplest, non-naïve univariate forecast method is best for forecasting ordinary conditions using conventional forecast accuracy measures, but the most complex multivariate model is best for forecasting exceptional conditions using ROC forecast accuracy measures.

Keywords: Forecast; accuracy; measures; Exception; reporting; ROC; curves; Crime; forecasting (search for similar items in EconPapers)
Date: 2009

Downloads: (external link)
http://www.sciencedirect.com/science/article/B6V92 ... 9b0381a17f88456292d8
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:eee:intfor:v:25:y:2009:i:1:p:48-61

Access Statistics for this article

International Journal of Forecasting is edited by R. J. Hyndman

More articles in International Journal of Forecasting from Elsevier
Series data maintained by Heidi Boesdal ().