Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models
Stephan B. Bruns () and
David Stern ()
Additional contact information
Stephan B. Bruns: University of Göttingen
Empirical Economics, 2019, vol. 56, issue 3, 797-830
Abstract The academic system incentivizes p-hacking, where researchers select estimates and statistics with statistically significant p-values for publication. We analyze the complete process of Granger causality testing including p-hacking using Monte Carlo simulations. If the degrees of freedom of the underlying vector autoregressive model are small to moderate, information criteria tend to overfit the lag length and overfitted vector autoregressive models tend to result in false-positive findings of Granger causality. Researchers may p-hack Granger causality tests by estimating multiple vector autoregressive models with different lag lengths and then selecting only those models that reject the null of Granger non-causality for presentation in the final publication. We show that overfitted lag lengths and the corresponding false-positive findings of Granger causality can frequently occur in research designs that are prevalent in empirical macroeconomics. We demonstrate that meta-regression models can control for spuriously significant Granger causality tests due to overfitted lag lengths. Finally, we find evidence that false-positive findings of Granger causality may be prevalent in the large literature that tests for Granger causality between energy use and economic output, while we do not find evidence for a genuine relation between these variables as tested in the literature.
Keywords: Granger causality; p-hacking; Publication bias; Information criteria; Meta-analysis; Vector autoregression (search for similar items in EconPapers)
JEL-codes: C12 C18 C32 Q43 (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
http://link.springer.com/10.1007/s00181-018-1446-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:spr:empeco:v:56:y:2019:i:3:d:10.1007_s00181-018-1446-3
Ordering information: This journal article can be ordered from
http://www.springer. ... rics/journal/181/PS2
Access Statistics for this article
Empirical Economics is currently edited by Robert M. Kunst, Arthur H.O. van Soest, Bertrand Candelon, Subal C. Kumbhakar and Joakim Westerlund
More articles in Empirical Economics from Springer
Bibliographic data for series maintained by Sonal Shukla ().