Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator

Joseph Cummins, Douglas Miller, Smith Brock and Simon David
Additional contact information
Smith Brock: Montana State University, Bozeman, USA
Simon David: University of Connecticut & NBER, Storrs, USA

Journal of Econometric Methods, 2024, vol. 13, issue 1, 67-95

Abstract: We investigate the properties of a systematic bias that arises in the synthetic control estimator in panel data settings with finite pre-treatment periods, offering intuition and guidance to practitioners. The bias comes from matching to idiosyncratic error terms (noise) in the treated unit and the donor units’ pre-treatment outcome values. This in turn leads to a biased counterfactual for the post-treatment periods. We use Monte Carlo simulations to evaluate the determinants of the bias in terms of error term variance, sample characteristics and DGP complexity, providing guidance as to which situations are likely to yield more bias. We also offer a procedure to reduce the bias using a direct computational bias-correction procedure based on re-sampling from a pilot model that can reduce the bias in empirically feasible implementations. As a final potential solution, we compare the performance of our corrections to that of an Interactive Fixed Effects model. An empirical application focused on trade liberalization indicates that the magnitude of the bias may be economically meaningful in a real world setting.

Keywords: synthetic control, over-fitting; program evaluation (search for similar items in EconPapers)
JEL-codes: C23 C52 (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/jem-2021-0019 (text/html)
For access to full text, subscription to the journal or payment for the individual article is required.

Related works:
Working Paper: Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:jecome:v:13:y:2024:i:1:p:67-95:n:2

Ordering information: This journal article can be ordered from
https://www.degruyter.com/view/j/jem

DOI: 10.1515/jem-2021-0019

Access Statistics for this article

More articles in Journal of Econometric Methods from De Gruyter
Bibliographic data for series maintained by Peter Golla ().