A Process Evaluation Examining the Performance, Adherence, and Acceptability of a Physical Activity and Diet Artificial Intelligence Virtual Health Assistant

Courtney R. Davis, Karen J. Murphy, Rachel G. Curtis and Carol A. Maher
Additional contact information
Courtney R. Davis: City East Campus, Alliance for Research in Exercise, Nutrition and Activity, University of South Australia, GPO Box 247, Adelaide 5001, Australia
Karen J. Murphy: City East Campus, Alliance for Research in Exercise, Nutrition and Activity, University of South Australia, GPO Box 247, Adelaide 5001, Australia
Rachel G. Curtis: City East Campus, Alliance for Research in Exercise, Nutrition and Activity, University of South Australia, GPO Box 247, Adelaide 5001, Australia
Carol A. Maher: City East Campus, Alliance for Research in Exercise, Nutrition and Activity, University of South Australia, GPO Box 247, Adelaide 5001, Australia

IJERPH, 2020, vol. 17, issue 23, 1-14

Abstract: Artificial intelligence virtual health assistants are a promising emerging technology. This study is a process evaluation of a 12-week pilot physical activity and diet program delivered by virtual assistant “Paola”. This single-arm repeated measures study ( n = 28, aged 45–75 years) was evaluated on technical performance (accuracy of conversational exchanges), engagement (number of weekly check-ins completed), adherence (percentage of step goal and recommended food servings), and user feedback. Paola correctly asked scripted questions and responded to participants during the check-ins 97% and 96% of the time, respectively, but correctly responded to spontaneous exchanges only 21% of the time. Participants completed 63% of weekly check-ins and conducted a total of 3648 exchanges. Mean dietary adherence was 91% and was lowest for discretionary foods, grains, red meat, and vegetables. Participants met their step goal 59% of the time. Participants enjoyed the program and found Paola useful during check-ins but not for spontaneous exchanges. More in-depth knowledge, personalized advice and spontaneity were identified as important improvements. Virtual health assistants should ensure an adequate knowledge base and ability to recognize intents and entities, include personality and spontaneity, and provide ongoing technical troubleshooting of the virtual assistant to ensure the assistant remains effective.

Keywords: virtual health assistant; conversational agent; chatbot; lifestyle; intervention; Mediterranean diet; physical activity; process evaluation (search for similar items in EconPapers)
JEL-codes: I I1 I3 Q Q5 (search for similar items in EconPapers)
Date: 2020
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1660-4601/17/23/9137/pdf (application/pdf)
https://www.mdpi.com/1660-4601/17/23/9137/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jijerp:v:17:y:2020:i:23:p:9137-:d:458126

Access Statistics for this article

IJERPH is currently edited by Ms. Jenna Liu

More articles in IJERPH from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().