Randomization Inference for Difference-in-Differences with Few Treated Clusters

James MacKinnon and Matthew Webb

No 16-11, Carleton Economic Papers from Carleton University, Department of Economics

Abstract: Inference using difference-in-differences with clustered data requires care. Previous research has shown that, when there are few treated clusters, t tests based on a cluster-robust variance estimator (CRVE) severely over-reject, different variants of the wild cluster bootstrap can over-reject or under-reject dramatically, and procedures based on randomization inference show promise. We demonstrate that randomization inference (RI) procedures based on estimated coefficients, such as the one proposed by Conley and Taber (2011), fail whenever the treated clusters are atypical. We propose an RI procedure based on t statistics which fails only when the treated clusters are atypical and few in number. We also propose a bootstrap-based alternative to randomization inference, which mitigates the discrete nature of RI P values when the number of clusters is small. Two empirical examples demonstrate that alternative procedures can yield dramatically different inferences.

Keywords: CRVE; grouped data; clustered data; panel data; randomization inference; difference-in-differences; wild cluster bootstrap; DiD (search for similar items in EconPapers)
JEL-codes: C12 C21 (search for similar items in EconPapers)
Pages: 27 pages
Date: 2016-06-25
New Economics Papers: this item is included in nep-sog
References: Add references at CitEc
Citations: View citations in EconPapers (15)

Published: Carleton Economic Papers

Downloads: (external link)
http://www.carleton.ca/economics/wp-content/uploads/cep16-11.pdf

Related works:
Journal Article: Randomization inference for difference-in-differences with few treated clusters (2020)
Working Paper: Randomization Inference For Difference-in-differences With Few Treated Clusters (2019)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:car:carecp:16-11

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Carleton Economic Papers from Carleton University, Department of Economics C870 Loeb Building, 1125 Colonel By Drive, Ottawa Ontario, K1S 5B6 Canada.
Bibliographic data for series maintained by Court Lindsay ().