Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator

Joseph Cummins, Brock Smith, Douglas Miller and David Simon

No 2023-07, Working papers from University of Connecticut, Department of Economics

Abstract: We investigate the properties of a systematic bias that arises in the synthetic control estimator in panel data settings with finite pre-treatment periods, offering intuition and guidance to practitioners. The bias comes from matching to idiosyncratic error terms (noise) in the treated unit and the donor units’ pre-treatment outcome values. This in turn leads to a biased counterfactual for the post-treatment periods. We use Monte Carlo simulations to evaluate the determinants of the bias in terms of error term variance, sample characteristics and DGP complexity, providing guidance as to which situations are likely to yield more bias. We also offer a procedure to reduce the bias using a direct computational bias-correction procedure based on re-sampling from a pilot model that can reduce the bias in empirically feasible implementations. As a final potential solution, we compare the performance of our corrections to that of an Interactive Fixed Effects model. An empirical application focused on trade liberalization indicates that the magnitude of the bias may be economically meaningful in a real world setting.

Keywords: Synthetic Control; Over-fitting (search for similar items in EconPapers)
JEL-codes: C23 C52 (search for similar items in EconPapers)
Pages: 57 pages
Date: 2023-10
New Economics Papers: this item is included in nep-ecm and nep-mac
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://media.economics.uconn.edu/working/2023-07.pdf Full text (application/pdf)

Related works:
Journal Article: Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:uct:uconnp:2023-07

Access Statistics for this paper

More papers in Working papers from University of Connecticut, Department of Economics University of Connecticut 365 Fairfield Way, Unit 1063 Storrs, CT 06269-1063. Contact information at EDIRC.
Bibliographic data for series maintained by Mark McConnel ().