Statistical Power in Cross-Sectional Multilevel Experiments in Education

Spyros Konstantopoulos (), Wei Li and Bixi Zhang ()
Additional contact information
Spyros Konstantopoulos: Michigan State University
Wei Li: University of Florida
Bixi Zhang: The Graduate Center, City University of New York

Chapter Chapter 16 in Dependent Data in Social Sciences Research, 2024, pp 397-440 from Springer

Abstract: Abstract This chapter focuses on a priori statistical power analysis in multilevel field experiments. Specifically, statistical power methods in two- and three-level cluster and block randomized designs are outlined. Altogether five experimental designs (two cluster and three block randomized) are defined. The sample size at the top level (e.g., schools) has a stronger impact on power than sample sizes at lower levels (e.g., classrooms, students) regardless of the type of the design. The magnitude of the treatment effect is positively related to power, and as the magnitude of the effect size increases, power increases as well. Clustering captured through intraclass correlations is inversely related to power, and thus decreases in clustering correspond to increases in power. Covariates that explain a considerable amount of the variance (e.g., ≥50%) at different levels increase power. In cluster designs, top-level covariates have a stronger influence on power compared to lower-level covariates (assuming cluster-mean centering). Power is typically larger in block randomized designs compared to cluster randomized designs. The two most powerful of the five designs seem to be the two-level block randomized design and the three-level block randomized design where the treatment is assigned at the bottom level.

Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-031-56318-8_16

Ordering information: This item can be ordered from
http://www.springer.com/9783031563188

DOI: 10.1007/978-3-031-56318-8_16

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().