Deep parameterizations of pairwise and triplet Markov models for unsupervised classification of sequential data

Hugo Gangloff, Katherine Morales and Yohan Petetin

Computational Statistics & Data Analysis, 2023, vol. 180, issue C

Abstract: Hidden Markov models are probabilistic graphical models based on hidden and observed random variables. They are popular to address classification tasks for time series applications such as part-of-speech tagging, image segmentation, genetic sequence analysis. Direct extensions of these models, the pairwise and triplet Markov models, are considered. These models aim at relaxing the assumptions underlying the hidden Markov chain by extending the direct dependencies of the involved random variables or by considering the addition of a third latent process. While these extensions define interesting modeling capabilities that have been little explored so far, they also raise new problems such as defining the nature of their core probability distributions and their parameterization. Once the model is fixed, the unsupervised classification task (i.e. the estimation of the parameters and next of the hidden random variables) is a critical problem. These challenges are addressed, first it is shown that it is possible to embed recent deep neural networks in these models in order to exploit their full modeling power. Second, a continuous latent process in triplet Markov chains is considered. The latter aims at estimating the nature of the joint distributions of the hidden and observed random variables, in addition to their parameters. The introduction of such a continuous auxiliary latent process also offers a new way to model continuous non-stationarity in hidden Markov models. For each model that is introduced, an original unsupervised Bayesian estimation method is proposed. In particular, it takes into account the interpretability of the hidden random variables in terms of signal processing classification. Through unsupervised classification problems on synthetic and real data, it is shown that the new models outperform hidden Markov chains and their classical extensions.

Keywords: Pairwise Markov chains; Triplet Markov chains; Deep neural networks; Variational expectation-maximization; Image segmentation (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947322002432
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:180:y:2023:i:c:s0167947322002432

DOI: 10.1016/j.csda.2022.107663

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().