A nascent design theory for explainable intelligent systems

Lukas-Valentin Herm (), Theresa Steinbach, Jonas Wanner and Christian Janiesch
Additional contact information
Lukas-Valentin Herm: Julius-Maximilians-Universität Würzburg
Theresa Steinbach: Julius-Maximilians-Universität Würzburg
Jonas Wanner: Julius-Maximilians-Universität Würzburg
Christian Janiesch: TU Dortmund University

Electronic Markets, 2022, vol. 32, issue 4, No 20, 2185-2205

Abstract: Abstract Due to computational advances in the past decades, so-called intelligent systems can learn from increasingly complex data, analyze situations, and support users in their decision-making to address them. However, in practice, the complexity of these intelligent systems renders the user hardly able to comprehend the inherent decision logic of the underlying machine learning model. As a result, the adoption of this technology, especially for high-stake scenarios, is hampered. In this context, explainable artificial intelligence offers numerous starting points for making the inherent logic explainable to people. While research manifests the necessity for incorporating explainable artificial intelligence into intelligent systems, there is still a lack of knowledge about how to socio-technically design these systems to address acceptance barriers among different user groups. In response, we have derived and evaluated a nascent design theory for explainable intelligent systems based on a structured literature review, two qualitative expert studies, a real-world use case application, and quantitative research. Our design theory includes design requirements, design principles, and design features covering the topics of global explainability, local explainability, personalized interface design, as well as psychological/emotional factors.

Keywords: Artificial intelligence; Explainable artificial intelligence; XAI; Design science research; Design theory; Intelligent systems (search for similar items in EconPapers)
JEL-codes: C6 C8 C9 M15 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://link.springer.com/10.1007/s12525-022-00606-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:elmark:v:32:y:2022:i:4:d:10.1007_s12525-022-00606-3

Ordering information: This journal article can be ordered from
http://www.springer. ... ystems/journal/12525

DOI: 10.1007/s12525-022-00606-3

Access Statistics for this article

Electronic Markets is currently edited by Rainer Alt and Hans-Dieter Zimmermann

More articles in Electronic Markets from Springer, IIM University of St. Gallen
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().