At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments?

Clément de Chaisemartin and Jaime Ramirez-Cuellar

American Economic Journal: Applied Economics, 2024, vol. 16, issue 1, 193-212

Abstract: In matched pairs experiments in which one cluster per pair of clusters is assigned to treatment, to estimate treatment effects, researchers often regress their outcome on a treatment indicator and pair fixed effects, clustering standard errors at the unit-of-randomization level. We show that even if the treatment has no effect, a 5 percent–level t-test based on this regression will wrongly conclude that the treatment has an effect up to 16.5 percent of the time. To fix this problem, researchers should instead cluster standard errors at the pair level. Using simulations, we show that similar results apply to clustered experiments with small strata.

JEL-codes: C21 C90 G21 O16 O18 (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://www.aeaweb.org/doi/10.1257/app.20210252 (application/pdf)
https://doi.org/10.3886/E168781V1 (text/html)
https://www.aeaweb.org/doi/10.1257/app.20210252.appx (application/pdf)
https://www.aeaweb.org/doi/10.1257/app.20210252.ds (application/zip)
Access to full text is restricted to AEA members and institutional subscribers.

Related works:
Working Paper: At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments? (2023)
Working Paper: At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments? (2022)
Working Paper: At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments? (2022)
Working Paper: At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments? (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aea:aejapp:v:16:y:2024:i:1:p:193-212

Ordering information: This journal article can be ordered from
https://www.aeaweb.org/journals/subscriptions

DOI: 10.1257/app.20210252

Access Statistics for this article

American Economic Journal: Applied Economics is currently edited by Alexandre Mas

More articles in American Economic Journal: Applied Economics from American Economic Association Contact information at EDIRC.
Bibliographic data for series maintained by Michael P. Albert ().