Online missing value imputation for high-dimensional mixed-type data via generalized factor models

Wei Liu, Lan Luo and Ling Zhou

Computational Statistics & Data Analysis, 2023, vol. 187, issue C

Abstract: The complete-observation requirement of most machine learning methods necessitates new statistical methods to handle datasets messy with missing values. This is especially urgent for streaming data that are generated at high speed and with a lack of quality control. Missing data imputation becomes an inevitable preprocessing step before subsequent analysis. A practical and meaningful online imputation algorithm should be not only scalable to large-scale datasets but also able to manage high-dimensional mixed-type data containing binary, count and continuous variables. To fill this gap, a novel online imputation algorithm, called OMIG, is proposed for streaming data under the framework of generalized factor models. To obtain deeper insight, OMIG is theoretically and empirically compared to its other two versions, the oracle version and the offline version. Theoretical and numerical findings show that (a) the imputed data obtained by OMIG are not equivalent to but instead at a slower rate than those obtained by its oracle version in terms of imputation accuracy; (b) OMIG outperforms its offline version in imputation accuracy; and (c) OMIG is equivalent to its oracle version in estimation accuracy for the factor loading, which largely facilitates interpretation and follow-up analysis. Extensive numerical experiments and two real datasets are used to demonstrate the performance of the proposed method.

Keywords: Generalized factor model; High-dimensional mixed-type data; Missing at random; Streaming data imputation (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947323001330
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:187:y:2023:i:c:s0167947323001330

DOI: 10.1016/j.csda.2023.107822

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().