What Can We Learn From 1000 Meta-Analyses Across 10 Different Disciplines?

Weilun Wu, Jianhua Duan, W. Robert Reed () and Elizabeth Tipton
Additional contact information
W. Robert Reed: University of Canterbury, https://www.canterbury.ac.nz

Working Papers in Economics from University of Canterbury, Department of Economics and Finance

Abstract: This study describes and analyzes 1000 meta-analyses across ten different disciplines spanning medicine, science, and the social sciences. It highlights significant variations in methodology across disciplines and offers targeted recommendations for enhancing research synthesis. Our analysis reveals discipline-specific differences in the number of studies and estimates per study, types of effect sizes used, and the prevalence of unpublished studies included in meta-analyses. It also examines the extent of effect heterogeneity and the employment of meta-regression to explain this heterogeneity across different fields. Our findings underscore the underutilization of robust meta-analytic methods like three-level models and CR2 clustered standard errors, which are crucial for addressing dependencies among multiple estimates within studies. Finally, we discuss the implications of publication bias and the prevalence of various tests and corrections across disciplines. Our recommendations aim to learn from and apply best practices across all disciplines. This work serves as a resource for researchers conducting their first meta-analyses, as a benchmark for researchers designing simulation experiments, and as a reference for applied meta-analysts aiming to improve their methodological practices.

Keywords: Meta-Analysis; Interdisciplinary comparison; Effect size heterogeneity; Tests for publication bias; Clustering; Meta-analytic estimators; Meta-regression; Statistical software (search for similar items in EconPapers)
JEL-codes: B41 C18 C80 (search for similar items in EconPapers)
Pages: 58 pages
Date: 2025-04-01
References: Add references at CitEc
Citations:

Downloads: (external link)
https://repec.canterbury.ac.nz/cbt/econwp/2507.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cbt:econwp:25/07

Access Statistics for this paper

More papers in Working Papers in Economics from University of Canterbury, Department of Economics and Finance Private Bag 4800, Christchurch, New Zealand. Contact information at EDIRC.
Bibliographic data for series maintained by Albert Yee ().