Revisiting the analysis of matched‐pair and stratified experiments in the presence of attrition

Yuehao Bai, Meng Hsuan Hsieh, Jizhou Liu and Max Tabord‐Meehan

Journal of Applied Econometrics, 2024, vol. 39, issue 2, 256-268

Abstract: In this paper, we revisit some common recommendations regarding the analysis of matched‐pair and stratified experimental designs in the presence of attrition. Our main objective is to clarify a number of well‐known claims about the practice of dropping pairs with an attrited unit when analyzing matched‐pair designs. Contradictory advice appears in the literature about whether or not dropping pairs is beneficial or harmful, and stratifying into larger groups has been recommended as a resolution to the issue. To address these claims, we derive the estimands obtained from the difference‐in‐means estimator in a matched‐pair design both when the observations from pairs with an attrited unit are retained and when they are dropped. We find limited evidence to support the claims that dropping pairs helps recover the average treatment effect, but we find that it may potentially help in recovering a convex‐weighted average of conditional average treatment effects. We report similar findings for stratified designs when studying the estimands obtained from a regression of outcomes on treatment with and without strata fixed effects.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/jae.3025

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:japmet:v:39:y:2024:i:2:p:256-268

Ordering information: This journal article can be ordered from
http://www3.intersci ... e.jsp?issn=0883-7252

Access Statistics for this article

Journal of Applied Econometrics is currently edited by M. Hashem Pesaran

More articles in Journal of Applied Econometrics from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().