Enhancing conversational agents for successful operation: A multi-perspective evaluation approach for continuous improvement

Tom Lewandowski (), Emir Kučević (), Stephan Leible (), Mathis Poser () and Tilo Böhmann ()
Additional contact information
Tom Lewandowski: University of Hamburg
Emir Kučević: University of Hamburg
Stephan Leible: University of Hamburg
Mathis Poser: University of Hamburg
Tilo Böhmann: University of Hamburg

Electronic Markets, 2023, vol. 33, issue 1, No 39, 20 pages

Abstract: Abstract Contemporary organizations increasingly adopt conversational agents (CAs) as intelligent and natural language-based solutions for providing services and information. CAs offer new forms of personalization, speed, (cost-)effectiveness, and automation. However, despite their hype in research and practice, many organizations still fail to seize CAs’ potential because they lack knowledge of how to evaluate and improve the quality of CAs to sustain them in organizational operations. We aim to fill this knowledge gap by conducting a design science research project in which we aggregate insights from the literature and practice to derive an applicable set of quality criteria for CAs. Our article contributes to CA research and guides practitioners by providing a blueprint to structure the evaluation of CAs and to discover areas for systematic improvement.

Keywords: Artificial intelligence assistants; Conversational agents; Chatbots; Quality criteria set; Design science research (DSR) (search for similar items in EconPapers)
JEL-codes: M15 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s12525-023-00662-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:elmark:v:33:y:2023:i:1:d:10.1007_s12525-023-00662-3

Ordering information: This journal article can be ordered from
http://www.springer. ... ystems/journal/12525

DOI: 10.1007/s12525-023-00662-3

Access Statistics for this article

Electronic Markets is currently edited by Rainer Alt and Hans-Dieter Zimmermann

More articles in Electronic Markets from Springer, IIM University of St. Gallen
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().