A Novel Approach for Allocating Mathematical Expressions to Visual Speech Signals

Mohammad Hossein Sadaghiani, Niusha Shafiabady and Dino Isa

SAGE Open, 2015, vol. 5, issue 4, 2158244015611937

Abstract: In this article, visual speech information modeling analysis by explicit mathematical expressions coupled with words’ phonemic structure is presented. The visual information is obtained from deformation of lips’ dimensions during articulation of a set of words that is called visual speech sample set. The continuous interpretation of the lips’ movement has been provided using Barycentric Lagrange Interpolation producing a unique mathematical expression named visual speech signal. Hierarchical analysis of the phoneme sequences has been applied for words’ categorization to organize the database properly. The visual samples were extracted from three visual feature points chosen on the lips via an experiment in which two individuals pronounced the aforementioned words. The simulation results show that each individual word can be represented by a mathematical expression or visual speech signal whereas the sample sets can also be derived from the same mathematical expression, and this is a significant improvement over the popular statistical methods.

Keywords: viseme; visual speech signal; Barycentric Lagrange Interpolation (search for similar items in EconPapers)
Date: 2015
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/2158244015611937 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:sagope:v:5:y:2015:i:4:p:2158244015611937

DOI: 10.1177/2158244015611937

Access Statistics for this article

More articles in SAGE Open
Bibliographic data for series maintained by SAGE Publications ().