Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models

Stephan B. Bruns () and David Stern
Additional contact information
Stephan B. Bruns: University of Göttingen

Empirical Economics, 2019, vol. 56, issue 3, No 2, 797-830

Abstract: Abstract The academic system incentivizes p-hacking, where researchers select estimates and statistics with statistically significant p-values for publication. We analyze the complete process of Granger causality testing including p-hacking using Monte Carlo simulations. If the degrees of freedom of the underlying vector autoregressive model are small to moderate, information criteria tend to overfit the lag length and overfitted vector autoregressive models tend to result in false-positive findings of Granger causality. Researchers may p-hack Granger causality tests by estimating multiple vector autoregressive models with different lag lengths and then selecting only those models that reject the null of Granger non-causality for presentation in the final publication. We show that overfitted lag lengths and the corresponding false-positive findings of Granger causality can frequently occur in research designs that are prevalent in empirical macroeconomics. We demonstrate that meta-regression models can control for spuriously significant Granger causality tests due to overfitted lag lengths. Finally, we find evidence that false-positive findings of Granger causality may be prevalent in the large literature that tests for Granger causality between energy use and economic output, while we do not find evidence for a genuine relation between these variables as tested in the literature.

Keywords: Granger causality; p-hacking; Publication bias; Information criteria; Meta-analysis; Vector autoregression (search for similar items in EconPapers)
JEL-codes: C12 C18 C32 Q43 (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://link.springer.com/10.1007/s00181-018-1446-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:empeco:v:56:y:2019:i:3:d:10.1007_s00181-018-1446-3

Ordering information: This journal article can be ordered from
http://www.springer. ... rics/journal/181/PS2

DOI: 10.1007/s00181-018-1446-3

Access Statistics for this article

Empirical Economics is currently edited by Robert M. Kunst, Arthur H.O. van Soest, Bertrand Candelon, Subal C. Kumbhakar and Joakim Westerlund

More articles in Empirical Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().