Mostly harmless simulations? Using Monte Carlo studies for estimator selection
Arun Advani,
Toru Kitagawa and
Tymon Słoczyński
Journal of Applied Econometrics, 2019, vol. 34, issue 6, 893-910
Abstract:
We consider two recent suggestions for how to perform an empirically motivated Monte Carlo study to help select a treatment effect estimator under unconfoundedness. We show theoretically that neither is likely to be informative except under restrictive conditions that are unlikely to be satisfied in many contexts. To test empirical relevance, we also apply the approaches to a real‐world setting where estimator performance is known. Both approaches are worse than random at selecting estimators that minimize absolute bias. They are better when selecting estimators that minimize mean squared error. However, using a simple bootstrap is at least as good and often better. For now, researchers would be best advised to use a range of estimators and compare estimates for robustness.
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)
Downloads: (external link)
https://doi.org/10.1002/jae.2724
Related works:
Working Paper: Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection (2019) 
Working Paper: Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection (2019) 
Working Paper: Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection (2019) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:wly:japmet:v:34:y:2019:i:6:p:893-910
Ordering information: This journal article can be ordered from
http://www3.intersci ... e.jsp?issn=0883-7252
Access Statistics for this article
Journal of Applied Econometrics is currently edited by M. Hashem Pesaran
More articles in Journal of Applied Econometrics from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().