Design Considerations in Multisite Randomized Trials Probing Moderated Treatment Effects

Nianbo Dong, Benjamin Kelcey and Jessaca Spybrook
Additional contact information
Nianbo Dong: 2331University of North Carolina at Chapel Hill
Benjamin Kelcey: 2514University of Cincinnati
Jessaca Spybrook: 4175Western Michigan University

Journal of Educational and Behavioral Statistics, 2021, vol. 46, issue 5, 527-559

Abstract: Past research has demonstrated that treatment effects frequently vary across sites (e.g., schools) and that such variation can be explained by site-level or individual-level variables (e.g., school size or gender). The purpose of this study is to develop a statistical framework and tools for the effective and efficient design of multisite randomized trials (MRTs) probing moderated treatment effects. The framework considers three core facets of such designs: (a) Level 1 and Level 2 moderators, (b) random and nonrandomly varying slopes (coefficients) of the treatment variable and its interaction terms with the moderators, and (c) binary and continuous moderators. We validate the formulas for calculating statistical power and the minimum detectable effect size difference with simulations, probe its sensitivity to model assumptions, execute the formulas in accessible software, demonstrate an application, and provide suggestions in designing MRTs probing moderated treatment effects.

Keywords: minimum detectable effect size difference; moderated treatment effect; multisite randomized trials (MRTs); statistical power (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998620961492 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:46:y:2021:i:5:p:527-559

DOI: 10.3102/1076998620961492

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().