A statistical test for forecast evaluation under a discrete loss function

Francisco Javier Eransus and Alfonso Novales
Additional contact information
Francisco Javier Eransus: Facultad de Ciencias Económicas y Empresariales. Universidad Complutense de Madrid.

No 2014-24, Documentos de Trabajo del ICAE from Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico

Abstract: We propose a new approach to evaluating the usefulness of a set of forecasts, based on the use of a discrete loss function de…ned on the space of data and forecasts. Existing procedures for such an evaluation either do not allow for formal testing, or use tests statistics based just on the frequency distribution of (data, forecasts)-pairs. They can easily lead to misleading conclusions in some reasonable situations, because of the way they formalize the underlying null hypothesis that ‘the set of forecasts is not useful.’ Even though the ambiguity of the underlying null hypothesis precludes us from performing a standard analysis of the size and power of the tests, we get results suggesting that the proposed DISC test performs better than its competitors.

Keywords: Forecasting Evaluation; Loss Function. (search for similar items in EconPapers)
JEL-codes: C12 C52 C53 (search for similar items in EconPapers)
Pages: 19 pages
Date: 2014
New Economics Papers: this item is included in nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://eprints.ucm.es/id/eprint/26435/1/1424.pdf (application/pdf)

Related works:
Working Paper: A statistical test for forecast evaluation under a discrete loss function (2011)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ucm:doicae:1424

Ordering information: This working paper can be ordered from
Facultad de Ciencias Económicas y Empresariales. Pabellón prefabricado, 1ª Planta, ala norte. Campus de Somosaguas, 28223 - POZUELO DE ALARCÓN (MADRID)
https://www.ucm.es/f ... -de-trabajo-del-icae

Access Statistics for this paper

More papers in Documentos de Trabajo del ICAE from Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico Contact information at EDIRC.
Bibliographic data for series maintained by Águeda González Abad ().