Recognition of Design Fixation via Body Language Using Computer Vision

Zhongliang Yang, Yumiao Chen and Song Zhang

Mathematical Problems in Engineering, 2021, vol. 2021, 1-18

Abstract:

The main objective of this study is to recognize design fixation accurately and effectively. First, we conducted an experiment to record the videos of design process and design sketches from 12 designers for 15 minutes. Then, we executed a video analysis of body language in designers, correlating body language to the presence of design fixation, as judged by a panel of six experts. We found that three body language types were significantly correlated to fixation. A two-step hybrid recognition model of design fixation based on body language was proposed. The first-step recognition model of body language using transfer learning based on a pretrained VGG-16 convolutional neural network was constructed. The average recognition rate achieved by the VGG-16 model was 92.03%. Then, the frames of recognized body language were used as input vectors to the second-step fixation classification model based on support vector machine (SVM). The average recognition rate for the fixation state achieved by the SVM model was 79.11%. The impact of the work could be that the fixation can be detected not only by the sketch outcomes but also by monitoring the movements, expressions, and gestures of designers, as it is happening by monitoring the movements, expressions, and gestures of designers.

Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://downloads.hindawi.com/journals/MPE/2021/6649300.pdf (application/pdf)
http://downloads.hindawi.com/journals/MPE/2021/6649300.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnlmpe:6649300

DOI: 10.1155/2021/6649300

Access Statistics for this article

More articles in Mathematical Problems in Engineering from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().