Specification Searching and Significance Inflation Across Time, Methods and Disciplines

Eva Vivalt

Oxford Bulletin of Economics and Statistics, 2019, vol. 81, issue 4, 797-816

Abstract: This paper examines how significance inflation has varied across time, methods and disciplines. Leveraging a unique data set of impact evaluations on 20 kinds of development programmes, I find that results from randomized controlled trials exhibit less significance inflation than results from studies using other methods. Further, randomized controlled trials have exhibited less significance inflation over time, but quasi‐experimental studies have not. There is no robust difference between results from researchers affiliated with economics departments and those from researchers affiliated with other predominantly health‐related departments. Overall, the biases found appear much smaller than those previously observed in other social sciences.

Date: 2019
References: Add references at CitEc
Citations: View citations in EconPapers (27)

Downloads: (external link)
https://doi.org/10.1111/obes.12289

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:obuest:v:81:y:2019:i:4:p:797-816

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0305-9049

Access Statistics for this article

Oxford Bulletin of Economics and Statistics is currently edited by Christopher Adam, Anindya Banerjee, Christopher Bowdler, David Hendry, Adriaan Kalwij, John Knight and Jonathan Temple

More articles in Oxford Bulletin of Economics and Statistics from Department of Economics, University of Oxford Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().