A latent variable approach to learning high-dimensional multivariate longitudinal data

Sze Ming Lee, Yunxiao Chen and Tony Sit

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for drawing statistical inferences on covariate effects and predicting future outcomes based on high-dimensional multivariate longitudinal data. This model introduces unobserved factors to account for the between-variable and across-time dependence and assist the prediction. Statistical inference and prediction tools are developed under a general setting that allows outcome variables to be of mixed types and possibly unobserved for certain time points, for example, due to right censoring. A central limit theorem is established for drawing statistical inferences on regression coefficients. Additionally, an information criterion is introduced to choose the number of factors. The proposed model is applied to customer grocery shopping records to predict and understand shopping behavior.

Keywords: factor model; missing data; recurrent event data (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Pages: 12 pages
Date: 2026-03-16
New Economics Papers: this item is included in nep-ecm
References: Add references at CitEc
Citations:

Published in Journal of the American Statistical Association, 16, March, 2026. ISSN: 0162-1459

Downloads: (external link)
https://researchonline.lse.ac.uk/id/eprint/130619/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:130619

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().