The Dangers of Data-Driven Inference: The Case of Calendar Effects in Stock Returns

Allan Timmermann, Halbert White and Ryan Sullivan

FMG Discussion Papers from Financial Markets Group

Abstract: Economics is primarily a non-experimental science. Typically, we cannot generate new data sets on which to test hypotheses independently of the data that may have led to a particular theory. The common practice of using the same data set to formulate and test hypotheses introduces data-snooping biases that, if not accounted for, invalidate the assumptions underlying classical statistical inference. A Striking example of a data-driven discovery is the presence of calendar effects in stock returns. There appears to be very substantial evidence of systematic abnormal stock returns related to the day of the week, the week of the month, the month of the year, the turn of the month, holidays, and so forth. However, this evidence has largely been considered without accounting for the intensive search preceding it. In this paper we use 100 years of daily data and a new bootstrap procedure that allows us to explicitly measure the distortions in statistical inference induced by data-snooping. We find that although nominal P-values of individual calendar rules are extremely significant, once evaluated in the context of the full universe form which such rules were drawn, calendar effects no longer remain significant.

Date: 1998-10
References: Add references at CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
http://www.lse.ac.uk/fmg/workingPapers/discussionPapers/fmg_pdfs/dp304.pdf (application/pdf)

Related works:
Working Paper: Dangers of Data-Driven Inference: The Case of Calendar Effects in Stock Returns (1998)
Working Paper: The dangers of data-driven inference: the case of calender effects in stock returns (1998)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fmg:fmgdps:dp304

Access Statistics for this paper

More papers in FMG Discussion Papers from Financial Markets Group
Bibliographic data for series maintained by The FMG Administration ().