Statistical vs. economic significance in economics and econometrics: further comments on McCloskey and Ziliak

Tom Engsted

Journal of Economic Methodology, 2009, vol. 16, issue 4, 393-408

Abstract: I comment on the controversy between McCloskey and Ziliak and Hoover and Siegler on statistical versus economic significance, in the March 2008 issue of the Journal of Economic Methodology. I argue that while McCloskey and Ziliak are right in emphasizing 'real error', i.e. non-sampling error that cannot be eliminated through specification testing, they fail to acknowledge those areas in economics, e.g. rational expectations macroeconomics and asset pricing, where researchers clearly distinguish between statistical and economic significance and where statistical testing plays a relatively minor role in model evaluation. In these areas models are treated as inherently misspecified and, consequently, are evaluated empirically by other methods than statistical tests. I also criticize McCloskey and Ziliak for their strong focus on the size of parameter estimates while neglecting the important question of how to obtain reliable estimates, and I argue that significance tests are useful tools in those cases where a statistical model serves as input in the quantification of an economic model. Finally, I provide a specific example from economics - asset return predictability - where the distinction between statistical and economic significance is well appreciated, but which also shows how statistical tests have contributed to our substantive economic understanding.

Keywords: statistical and economic significance; statistical hypothesis testing; model evaluation; misspecified models (search for similar items in EconPapers)
Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (19)

Downloads: (external link)
http://www.tandfonline.com/doi/abs/10.1080/13501780903337339 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:jecmet:v:16:y:2009:i:4:p:393-408

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/RJEC20

DOI: 10.1080/13501780903337339

Access Statistics for this article

Journal of Economic Methodology is currently edited by John Davis and D Wade Hands

More articles in Journal of Economic Methodology from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().