Practical Significance, Meta-Analysis and the Credibility of Economics

T. Stanley and Chris Doucouliagos

No 12458, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: Recently, there has been much discussion about replicability and credibility. By integrating the full research record, increasing statistical power, reducing bias and enhancing credibility, meta-analysis is widely regarded as 'best evidence'. Through Monte Carlo simulation, closely calibrated on the typical conditions found among 6,700 economics research papers, we find that large biases and high rates of false positives will often be found by conventional meta-analysis methods. Nonetheless, the routine application of meta-regression analysis and considerations of practical significance largely restore research credibility.

Keywords: meta-analysis; meta-regression; publication bias; credibility; simulations (search for similar items in EconPapers)
JEL-codes: C10 C12 C13 C40 (search for similar items in EconPapers)
Pages: 53 pages
Date: 2019-07
New Economics Papers: this item is included in nep-ecm, nep-hpe, nep-ore and nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://docs.iza.org/dp12458.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp12458

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().