Integrating Biofeedback and Artificial Intelligence into eXtended Reality Training Scenarios: A Systematic Literature Review

Karen L. Blackmore, Shamus P. Smith, Jacqueline D. Bailey and Benjamin Krynski

Simulation & Gaming, 2024, vol. 55, issue 3, 445-478

Abstract: Background The addition of biofeedback and artificial intelligence (AI) in simulation training and serious games has shown promising results in improving the effectiveness of training and can lead to increased engagement, motivation, and retention of information. This systematic literature review explores the integration of biofeedback and artificial intelligence into eXtended reality (XR) training scenarios and is the first review to provide a consolidated overview of applied biofeedback and AI technologies in this area. Method This review was conducted using keywords related to biofeedback, AI, XR, and training and included papers that: contained the use of biofeedback and AI in XR training scenarios; reported on at least one outcome related to training effectiveness; were published in English; were peer-reviewed; date from 1 January 2016 – 7 February 2022. Results The results indicate that many studies collect two or more biosignals using a single biosensing device. This is particularly relevant in applied settings, where ease of use and minimal interference in training/education activities is desired. Also, that light, portable devices such as wrist bands, wireless straps, or headbands are preferred. Additionally, eye tracking, electrodermal activity (EDA), and photoplethysmograms (PPG) present as particularly useful biomarkers of stress and/or cognitive load in XR training contexts. A wide variety of machine learning (ML) approaches were used to support biofeedback systems in XR environments. However, a limited number of studies employed real-time analysis of biosignals (just 1% of studies) which indicates current challenges in implementing such systems. Conclusion The majority of papers meeting the selection criteria were from the fields of education and healthcare. Further research in other domains, such as defense and general industry, is needed to gain a comprehensive understanding of the potential for biofeedback and AI integration in XR training scenarios used in these domains.

Keywords: artificial intelligence; biofeedback; review; extended reality; simulation-based training (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/10468781241236688 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:simgam:v:55:y:2024:i:3:p:445-478

DOI: 10.1177/10468781241236688

Access Statistics for this article

More articles in Simulation & Gaming
Bibliographic data for series maintained by SAGE Publications ().