Heart Rate Estimation Algorithm Integrating Long and Short-Term Temporal Features

Jie Sun, Zhanwang Zhang, Jiaqi Liu, Lijian Zhou and Songtao Hu ()
Additional contact information
Jie Sun: School of Information and Control Engineering, Qingdao University of Technology, Qingdao 266033, China
Zhanwang Zhang: School of Information and Control Engineering, Qingdao University of Technology, Qingdao 266033, China
Jiaqi Liu: School of Information and Control Engineering, Qingdao University of Technology, Qingdao 266033, China
Lijian Zhou: School of Information and Control Engineering, Qingdao University of Technology, Qingdao 266033, China
Songtao Hu: School of Environmental and Municipal Engineering, Qingdao University of Technology, Qingdao 266033, China

Mathematics, 2024, vol. 12, issue 21, 1-16

Abstract: Non-contact heart rate monitoring from facial videos utilizing remote photoplethysmography (rPPG) has gained significant traction in remote health monitoring. Given that rPPG captures the dynamic blood flow within the human body and constitutes a time-series signal characterized by periodic properties, this study introduced a three-dimensional convolutional neural network (3D CNN) designed to simultaneously address long-term periodic and short-term temporal characteristics for effective rPPG signal extraction. Firstly, differential operations are employed to preprocess video data, enhancing the face’s dynamic features. Secondly, building upon the 3D CNN framework, multi-scale dilated convolutions and self-attention mechanisms were integrated to enhance the model’s temporal modeling capabilities further. Finally, interpolation techniques are applied to refine the heart rate calculation methodology. The experiments conducted on the UBFC-rPPG dataset indicate that, compared with the existing optimal algorithm, the average absolute error (MAE) and the root mean square error (RMSE) realized significant enhancements of approximately 28% and 35%. Additionally, through comprehensive analyses such as cross-dataset experiments and complexity analyses, the validity and stability of the proposed algorithm in the task of heart rate estimation were manifested.

Keywords: rPPG; self-attention; 3D CNN (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/21/3444/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/21/3444/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:21:p:3444-:d:1513724

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().