Statistical model selection with “Big Data”

Jurgen Doornik, David F. Hendry and Steve Cook

Cogent Economics & Finance, 2015, vol. 3, issue 1, 1045216

Abstract: Big Data offer potential benefits for statistical modelling, but confront problems including an excess of false positives, mistaking correlations for causes, ignoring sampling biases and selecting by inappropriate methods. We consider the many important requirements when searching for a data-based relationship using Big Data, and the possible role of Autometrics in that context. Paramount considerations include embedding relationships in general initial models, possibly restricting the number of variables to be selected over by non-statistical criteria (the formulation problem), using good quality data on all variables, analyzed with tight significance levels by a powerful selection procedure, retaining available theory insights (the selection problem) while testing for relationships being well specified and invariant to shifts in explanatory variables (the evaluation problem), using a viable approach that resolves the computational problem of immense numbers of possible models.

Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
http://hdl.handle.net/10.1080/23322039.2015.1045216 (text/html)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Statistical Model Selection with 'Big Data' (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:oaefxx:v:3:y:2015:i:1:p:1045216

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/OAEF20

DOI: 10.1080/23322039.2015.1045216

Access Statistics for this article

Cogent Economics & Finance is currently edited by Steve Cook, Caroline Elliott, David McMillan, Duncan Watson and Xibin Zhang

More articles in Cogent Economics & Finance from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().