Confidence Intervals for Intentionally Biased Estimators
David Kaplan and
Xin Liu
No 2308, Working Papers from Department of Economics, University of Missouri
Abstract:
We propose and study two confidence intervals (CIs) centered at an estimator that is intentionally biased in order to reduce mean squared error. The first CI simply uses an unbiased estimator's standard error. It is not obvious that this CI should work well; indeed, for confidence levels below 68.3%, the coverage probability can be near zero, and the CI using the biased estimator's standard error is also known to suffer from undercoverage. However, for confidence levels 91.7% and higher, even if the unbiased and biased estimators have identical mean squared error (which yields a bound on coverage probability), our CI is better than the benchmark CI centered at the unbiased estimator: they are the same length, but our CI has higher coverage probability (lower coverage error rate), regardless of the magnitude of bias. That is, whereas generally there is a tradeoff that requires increasing CI length in order to reduce the coverage error rate, in this case we can reduce the error rate for free (without increasing length) simply by recentering the CI at the biased estimator instead of the unbiased estimator. If rounding to the nearest hundredth of a percent, then even at the 90% confidence level our CI's worst-case coverage probability is 90.00% and can be significantly higher depending on the magnitude of bias. In addition to its favorable statistical properties, our proposed CI applies broadly and is simple to compute, making it attractive in practice. Building on these results, our second CI trades some of the first CI's "excess" coverage probability for shorter length. It also dominates the benchmark CI (centered at unbiased estimator) for conventional confidence levels, with higher coverage probability and shorter length, so we recommend this CI in practice.
Keywords: averaging estimators; bias-variance tradeoff; coverage probability; mean squared error; smoothing (search for similar items in EconPapers)
JEL-codes: C13 (search for similar items in EconPapers)
Date: 2023-06
New Economics Papers: this item is included in nep-ecm and nep-mfd
References: Add references at CitEc
Citations:
Downloads: (external link)
https://drive.google.com/file/d/13l6_IROJrZim5NLRk ... rir/view?usp=sharing (application/pdf)
Related works:
Working Paper: Confidence intervals for intentionally biased estimators (2025) 
Journal Article: Confidence intervals for intentionally biased estimators (2024) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:umc:wpaper:2308
Access Statistics for this paper
More papers in Working Papers from Department of Economics, University of Missouri Contact information at EDIRC.
Bibliographic data for series maintained by Chao Gu ().