A Simple Adjustment for Bandwidth Snooping

Timothy Armstrong and Michal Kolesár

The Review of Economic Studies, 2018, vol. 85, issue 2, 732-765

Abstract: Kernel-based estimators such as local polynomial estimators in regression discontinuity designs are often evaluated at multiple bandwidths as a form of sensitivity analysis. However, if in the reported results, a researcher selects the bandwidth based on this analysis, the associated confidence intervals (CIs) may not have correct coverage, even if the estimator is unbiased. This article proposes a simple adjustment that gives correct coverage in such situations: replace the normal quantile with a critical value that depends only on the kernel and ratio of the maximum and minimum bandwidths the researcher has entertained. We tabulate these critical values and quantify the loss in coverage for conventional CIs. For a range of relevant cases, a conventional 95% CI has coverage between 70% and 90%, and our adjustment amounts to replacing the conventional critical value 1.96 with a number between 2.2 and 2.8. Our results also apply to other settings involving trimmed data, such as trimming to ensure overlap in treatment effect estimation. We illustrate our approach with three empirical applications.

Keywords: Nonparametric estimation; Multiple testing; Regression discontinuity; Bandwidth selection (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://hdl.handle.net/10.1093/restud/rdx051 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: A Simple Adjustment for Bandwidth Snooping (2017)
Working Paper: A Simple Adjustment for Bandwidth Snooping (2016)
Working Paper: A Simple Adjustment for Bandwidth Snooping (2015)
Working Paper: A Simple Adjustment for Bandwidth Snooping (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:restud:v:85:y:2018:i:2:p:732-765.

Access Statistics for this article

The Review of Economic Studies is currently edited by Thomas Chaney, Xavier d’Haultfoeuille, Andrea Galeotti, Bård Harstad, Nir Jaimovich, Katrine Loken, Elias Papaioannou, Vincent Sterk and Noam Yuchtman

More articles in The Review of Economic Studies from Review of Economic Studies Ltd
Bibliographic data for series maintained by Oxford University Press ().