Multilayer‐neighbor local binary pattern for facial expression recognition

Wei‐Yen Hsu, Hsien‐Jen Hsu, Yen‐Yao Wang and Tawei Wang

Intelligent Systems in Accounting, Finance and Management, 2022, vol. 29, issue 3, 156-168

Abstract: Facial expression recognition (FER) has drawn the interest of practitioners and researchers due to its potential in opening new business opportunities. One critical aspect of any successful FER system is a feature extraction method that can efficiently find sufficient facial features and characterize facial expressions. This paper proposes an appearance‐based feature extraction method by introducing a local feature descriptor, a multilayer‐neighbor local binary pattern (LBP), for recognizing facial expressions. This new LBP operator is an extension of the original one‐layer‐neighbor LBP to two‐layer‐neighbor and three‐layer‐neighbor LBPs. We extract features by comparing new center points with neighborhood points. In addition, based on facial landmark locations, we extract active facial blocks during emotional stimulations. These prominent facial blocks utilize facial symmetry to improve the accuracy and speed of expression recognition. After using principal component analysis to reduce the dimensionality of features, we use a support vector machine to assign expressions to seven categories. We evaluate the proposed method by comparing it with other commonly used methods, and the proposed method is more accurate. Implications for business researchers are discussed.

Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/isaf.1520

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:isacfm:v:29:y:2022:i:3:p:156-168

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1099-1174

Access Statistics for this article

More articles in Intelligent Systems in Accounting, Finance and Management from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().