Equivalences between ad hoc strategies and meta-analytic models for dependent effect sizes

James Pustejovsky and Man Chen

No pw54r, MetaArXiv from Center for Open Science

Abstract: Meta-analyses of educational research findings frequently involve statistically dependent effect size estimates. Meta-analysts have often addressed dependence issues using ad hoc approaches that involve modifying the data to conform to the assumptions of models for independent effect size estimates, such as aggregating estimates to obtain one summary estimate per study, conducting separate analyses of distinct subgroups of estimates, or combinations thereof. We demonstrate that these ad hoc approaches correspond exactly to certain multivariate models for dependent effect sizes. Specifically, we describe classes of multivariate random effects models that have likelihoods equivalent to those of models for effect sizes that have been averaged by study, classified into subgroups, or both. The equivalence also applies to robust variance estimation methods.

Date: 2023-07-27
New Economics Papers: this item is included in nep-ecm
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/64bad8dbb49dcb0657736a6e/

Related works:
Working Paper: Equivalences between ad hoc strategies and meta-analytic models for dependent effect sizes (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:metaar:pw54r

DOI: 10.31219/osf.io/pw54r

Access Statistics for this paper

More papers in MetaArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().