Elevating Developers' Accountability Awareness in AI Systems Development: The Role of Process and Outcome Accountability Arguments

Jan-Hendrik Schmidt, Sebastian Clemens Bartsch, Martin Adam and Alexander Benlian

Publications of Darmstadt Technical University, Institute for Business Studies (BWL) from Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL)

Abstract: The increasing proliferation of artificial intelligence (AI) systems presents new challenges for the future of information systems (IS) development, especially in terms of holding stakeholders accountable for the development and impacts of AI systems. However, current governance tools and methods in IS development, such as AI principles or audits, are often criticized for their ineffectiveness in influencing AI developers’ attitudes and perceptions. Drawing on construal level theory and Toulmin’s model of argumentation, this paper employed a sequential mixed method approach to integrate insights from a randomized online experiment (Study 1) and qualitative interviews (Study 2). This combined approach helped us investigate how different types of accountability arguments affect AI developers’ accountability perceptions. In the online experiment, process accountability arguments were found to be more effective than outcome accountability arguments in enhancing AI developers’ perceived accountability. However, when supported by evidence, both types of accountability arguments prove to be similarly effective. The qualitative study corroborates and complements the quantitative study’s conclusions, revealing that process and outcome accountability emerge as distinct theoretical constructs in AI systems development. The interviews also highlight critical organizational and individual boundary conditions that shape how AI developers perceive their accountability. Together, the results contribute to IS research on algorithmic accountability and IS development by revealing the distinct nature of process and outcome accountability while demonstrating the effectiveness of tailored arguments as governance tools and methods in AI systems development.

Date: 2025-02
Note: for complete metadata visit http://tubiblio.ulb.tu-darmstadt.de/154037/
References: Add references at CitEc
Citations:

Published in Business & Information Systems Engineering : The International Journal of Wirtschaftsinformatik 1 (2025-02) : pp. 109-135

Downloads: (external link)
https://tuprints.ulb.tu-darmstadt.de/29644

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dar:wpaper:154037

Access Statistics for this paper

More papers in Publications of Darmstadt Technical University, Institute for Business Studies (BWL) from Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL) Contact information at EDIRC.
Bibliographic data for series maintained by Dekanatssekretariat ().