Standardized Mean Differences: Not So Standard After All

Juyoung Jung and Ariel M. Aloe

Campbell Systematic Reviews, 2025, vol. 21, issue 3

Abstract: Meta‐analyses often use standardized mean differences (SMDs), such as Cohen's d and Hedges' g, to compare treatment effects. However, these SMDs are highly sensitive to the within‐study sample variability used for their standardization, potentially distorting individual effect size estimates and compromising overall meta‐analytic conclusions. This study introduces harmonized standardized mean differences (HSMDs), a novel sensitivity analysis framework designed to systematically evaluate and address such distortions. The HSMD harmonizes relative within‐study variability across studies by employing the coefficient of variation (CV) to establish empirical benchmarks (e.g., CV quartiles). SMDs are then recalculated under these consistent variability assumptions. Applying this framework to Meta‐analytic data reveals the extent to which (original) effect sizes and pooled results are influenced by initial, study‐specific standard deviations to standardize mean differences. Furthermore, the method facilitates the inclusion of studies lacking reported variability metrics into the sensitivity analysis, enhancing the comprehensiveness of the meta‐analytic synthesis.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/cl2.70056

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:camsys:v:21:y:2025:i:3:n:e70056

Access Statistics for this article

More articles in Campbell Systematic Reviews from John Wiley & Sons
Bibliographic data for series maintained by Wiley Content Delivery ().