A conversational agent framework for mental health screening: design, implementation, and usability

Rares Boian, Ana-Maria Bucur, Diana Todea, Andreea Luca, Traian Rebedea and Ioana R. Podina

Behaviour and Information Technology, 2025, vol. 44, issue 10, 2364-2378

Abstract: While chatbots show promise for large-scale mental health screening, few offer interactive, free-text conversations, limiting their appeal for self-administered screening and impeding the timely detection of mental health issues. This study introduces an AI-based chatbot that allows users to respond to validated screening surveys for mental disorders (PHQ-9, GAD-7, and PCL-5) in a natural, free-text conversation manner with real-time feedback. The study's objectives include evaluating the chatbot's usability and reducing the frequency of response clarifications while accurately interpreting users’ responses. The system was assessed running in hybrid NLU mode (Phase 2; N = 587; Mage = 21.56, SD = 5.56, 67.8% women) after being trained on data collected while running in rule-based mode (Phase 1; N = 274; Mage = 21.86, SD = 5.50). During user-chatbot interactions, the chatbot required clarification only 4.64% of the time. Using the AI NLU model, the chatbot could understand user responses in 85.65% of cases and interpret free-text similarly to human annotators. In terms of usability, the chatbot in hybrid NLU mode was perceived as more engaging, friendly, and easier to use than in the rule-based NLU mode, which may be indirectly attributed to the enhanced autonomy provided by the AI NLU model.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/0144929X.2024.2332934 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tbitxx:v:44:y:2025:i:10:p:2364-2378

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tbit20

DOI: 10.1080/0144929X.2024.2332934

Access Statistics for this article

Behaviour and Information Technology is currently edited by Dr Panos P Markopoulos

More articles in Behaviour and Information Technology from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().