Forecast Evaluation with Shared Data Sets

Halbert White, Allan Timmermann and Ryan Sullivan

No 3060, CEPR Discussion Papers from C.E.P.R. Discussion Papers

Abstract: Data sharing is common practice in forecasting experiments in situations where fresh data samples are difficult or expensive to generate. This means that forecasters often analyze the same data set using a host of different models and sets of explanatory variables. This practice introduces statistical dependencies across forecasting studies that can severely distort statistical inference. Here we examine a new and inexpensive recursive bootstrap procedure that allows forecasters to account explicitly for these dependencies. The procedure allows forecasters to merge empirical evidence and draw inference in the light of previously accumulated results. In an empirical example, we merge results from predictions of daily stock prices based on (1) technical trading rules and (2) calendar rules, demonstrating both the significance of problems arising from data sharing and the simplicity of accounting for data sharing using these new methods.

Keywords: Forecast evaluation; Bootstrap; Data sharing; Calendar effects; Technical trading (search for similar items in EconPapers)
JEL-codes: C10 (search for similar items in EconPapers)
Date: 2001-11
References: Add references at CitEc
Citations:

Downloads: (external link)
https://cepr.org/publications/DP3060 (application/pdf)
CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org

Related works:
Journal Article: Forecast evaluation with shared data sets (2003)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cpr:ceprdp:3060

Ordering information: This working paper can be ordered from
https://cepr.org/publications/DP3060

Access Statistics for this paper

More papers in CEPR Discussion Papers from C.E.P.R. Discussion Papers Centre for Economic Policy Research, 33 Great Sutton Street, London EC1V 0DX.
Bibliographic data for series maintained by ().