A memory-based method to select the number of relevant components in Principal Component Analysis

Anshul Verma, Pierpaolo Vivo and Tiziana Di Matteo

Papers from arXiv.org

Abstract: We propose a new data-driven method to select the optimal number of relevant components in Principal Component Analysis (PCA). This new method applies to correlation matrices whose time autocorrelation function decays more slowly than an exponential, giving rise to long memory effects. In comparison with other available methods present in the literature, our procedure does not rely on subjective evaluations and is computationally inexpensive. The underlying basic idea is to use a suitable factor model to analyse the residual memory after sequentially removing more and more components, and stopping the process when the maximum amount of memory has been accounted for by the retained components. We validate our methodology on both synthetic and real financial data, and find in all cases a clear and computationally superior answer entirely compatible with available heuristic criteria, such as cumulative variance and cross-validation.

Date: 2019-04, Revised 2019-10
New Economics Papers: this item is included in nep-ecm and nep-ets
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Published in Journal of Statistical Mechanics: Theory and Experiment, 2019

Downloads: (external link)
http://arxiv.org/pdf/1904.05931 Latest version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:1904.05931

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators ().