Regime switching model estimation: spectral clustering hidden Markov model

Kai Zheng (), Yuying Li () and Weidong Xu ()
Additional contact information
Kai Zheng: Zhejiang University
Yuying Li: University of Waterloo
Weidong Xu: Zhejiang University

Annals of Operations Research, 2021, vol. 303, issue 1, No 14, 297-319

Abstract: Abstract We propose a novel method for Markov regime switching (MRS) model estimations by spectral clustering hidden Markov model (SC-HMM). The proposed SC-HMM exploits the Markov property of hidden states and utilizes pairwise feature similarities for latent state identifications. It can be applied to general hidden Markov models (HMMs) with continuous observations. In contrast to the maximum likelihood estimation (MLE), SC-HMM predicts latent states and yields conditional distribution statistics without knowledge of types of conditional distributions. To illustrate, SC-HMM is first applied to a simple HMM with discrete observations. We consider the MRS model estimation with continuous observations to further demonstrate SC-HMM. Specifically, based on local observations, we propose a set of features for the MRS estimation. A similarity matrix is determined from derived features and spectral clustering predicts latent states. Conditional distribution statistics and transitional probabilities are estimated based on identified latent states. By conducting simulation studies on both two-state and three-state MRS estimations, we demonstrate that, in comparison with MLE, the proposed SC-HMM is more robust. Furthermore, we demonstrate the validity of SC-HMM by estimating a two-state MRS from the S&P/TSX Composite Index daily and monthly data from 1977 to 2014.

Keywords: Data mining; Spectral clustering; Hidden Markov models; Markov regime-switching; Feature construction (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://link.springer.com/10.1007/s10479-019-03140-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:annopr:v:303:y:2021:i:1:d:10.1007_s10479-019-03140-2

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10479

DOI: 10.1007/s10479-019-03140-2

Access Statistics for this article

Annals of Operations Research is currently edited by Endre Boros

More articles in Annals of Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().