Group-Level Human Affect Recognition with Multiple Graph Kernel Fusion

Xiaohua Huang ()
Additional contact information
Xiaohua Huang: Nanjing Institute of Technology

Chapter Chapter 11 in City, Society, and Digital Transformation, 2022, pp 127-140 from Springer

Abstract: Abstract Research on group-level affect recognition has become emerging for predicting human behavior in a group. Due to the variability in group size, a critical issue should be addressed. That is, how to efficiently and effectively describe the affect similarity of two group-level images. To tackle this problem, this paper makes two-fold contributions: (1) similarity measurement of group affect based on graph kernel; (2) incorporation of multiple kernels and deep learning architecture to contribute to recognizing group-level affect. In this paper, we view a group as a graph. Thus, we first formulated the graph of the group, and then build the kernel between any two graphs. Its advantage is to efficiently use any kernel classifier. To further exploit the advantages of multiple kernels, we used two feature descriptors to extract the face features. Subsequently, we proposed straightforwardly using deep multiple kernel learning with three-layer. To resolve non-differential problem, we presented the graph kernel as the input of four kinds of base kernels and learned their corresponding weights. Intensive experiments are performed on a challenging group-level affective database. Performance comparisons considerably demonstrate the advantages of graph kernel and deep multiple kernel learning. Additionally, our proposed approach obtains promising performance for group-level affect recognition compared with the recent state-of-the-art methods.

Keywords: Group affect; Graph; Multiple kernel learning; Deep learning; Feature fusion (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:lnopch:978-3-031-15644-1_11

Ordering information: This item can be ordered from
http://www.springer.com/9783031156441

DOI: 10.1007/978-3-031-15644-1_11

Access Statistics for this chapter

More chapters in Lecture Notes in Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().