Accounting for sample overlap in economics meta‐analyses: The generalized‐weights method in practice

Pedro R. D. Bom and Heiko Rachinger

Journal of Economic Surveys, 2025, vol. 39, issue 3, 904-931

Abstract: Meta‐analyses in economics frequently exhibit considerable overlap among primary samples. If not addressed, sample overlap leads to efficiency losses and inflated rates of false positives at the meta‐analytical level. In previous work, we proposed a generalized‐weights (GW) approach to handle sample overlap. This approach effectively approximates the correlation structure between primary estimates using information on sample sizes and overlap degrees in the primary studies. This paper demonstrates the application of the GW method to economics meta‐analyses, addressing practical challenges that are likely to be encountered. We account for variations in data aggregation levels, estimation methods, and effect size metrics, among other issues. We derive explicit covariance formulas for different scenarios, evaluate the accuracy of the approximations, and employ Monte Carlo simulations to demonstrate how the method enhances efficiency and restores the false positive rate to its nominal level.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/joes.12633

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jecsur:v:39:y:2025:i:3:p:904-931

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0950-0804

Access Statistics for this article

More articles in Journal of Economic Surveys from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().