Missing Data Substitution for Enhanced Robust Filtering and Forecasting in State-Space Models

Dobrislav Dobrev () and Pawel J. Szerszen ()

No 2026-004, Working Papers from The George Washington University, The Center for Economic Research

Abstract: Replacing erroneous observations with missing values is known to mitigate outlier-induced distortions in state-space model inference. Yet, in economic data, outliers can be small and difficult to detect, while still occurring in temporal clusters and generating persistent distortions. We therefore put forward an unsupervised approach for exogenously randomized substitution of missing data (RMDX), designed as an ensemble-averaging enhancement that can be used to improve the robustness of any filter also to more elusive outliers. Our bias-variance decomposition theory for RMDX ensemble averaging establishes that, under mild regularity conditions on the influence of outliers, the missing data randomization rate acts as a regularization parameter, which can be set optimally to minimize mean squared error loss using standard cross-validation. We corroborate these theoretical results using Monte Carlo simulations, which show that RMDX ensemble averaging can substantially enhance the performance of commonly used robust filters, including ones that rely on supervised missing data substitution upon exceeding outlier detection thresholds. As anticipated, the gains are most pronounced in the presence of patches of moderately sized outliers that are difficult to mitigate. To further assess empirical relevance in economics, we also document that RMDX-enhanced filters perform favorably in widely used state-space models for extracting inflation trends, where clusters of measurement outliers in inflation data are known to pose an extra challenge.

Keywords: State-space models; outlier-robust filtering and forecasting; missing data randomization; bagging and ensemble averaging; bias-variance tradeoff. (search for similar items in EconPapers)
JEL-codes: C15 C22 C53 E37 (search for similar items in EconPapers)
Pages: 39 pages
Date: 2026-03
New Economics Papers: this item is included in nep-ecm, nep-ets and nep-for
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www2.gwu.edu/~forcpgm/2026-004.pdf First version, 2026 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gwc:wpaper:2026-004

Access Statistics for this paper

More papers in Working Papers from The George Washington University, The Center for Economic Research Contact information at EDIRC.
Bibliographic data for series maintained by GW Economics Department ().