Economics at your fingertips  

Cherry Picking with Synthetic Controls

Bruno Ferman, Cristine Pinto () and Vitor Possebom ()

Journal of Policy Analysis and Management, 2020, vol. 39, issue 2, 510-532

Abstract: We evaluate whether a lack of guidance on how to choose the matching variables used in the Synthetic Control (SC) estimator creates specification‐searching opportunities. We provide theoretical results showing that specification‐searching opportunities are asymptotically irrelevant if we restrict to a subset of SC specifications. However, based on Monte Carlo simulations and simulations with real datasets, we show significant room for specification searching when the number of pre‐treatment periods is in line with common SC applications, and when alternative specifications commonly used in SC applications are also considered. This suggests that such lack of guidance generates a substantial level of discretion in the choice of the comparison units in SC applications, undermining one of the advantages of the method. We provide recommendations to limit the possibilities for specification searching in the SC method. Finally, we analyze the possibilities for specification searching and provide our recommendations in a series of empirical applications.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (19) Track citations by RSS feed

Downloads: (external link)

Related works:
Working Paper: Cherry Picking with Synthetic Controls (2017) Downloads
Working Paper: Cherry picking with synthetic controls (2016) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link:

Access Statistics for this article

More articles in Journal of Policy Analysis and Management from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().

Page updated 2022-06-25
Handle: RePEc:wly:jpamgt:v:39:y:2020:i:2:p:510-532