Ethical Procedures for Responsible Experimental Evaluation of AI-based Education Interventions

Izaak Dekker, Bert Bredeweg, Wilco te Winkel and Ibo van de Poel

No 3dynw, OSF Preprints from Center for Open Science

Abstract: AI-based interventions could enhance learning by personalization, improving teacher effectiveness, or optimize educational processes. However, they could also have unintended or unexpected side-effects, such as undermining learning by enabling procrastination, or reducing social interaction by individualizing learning processes. Responsible experiments are required to map both the potential benefits and the side-effects. Current procedures used to screen experiments by ethical review boards do not take the specific risks and dilemmas that AI poses into account. Previous studies identified sixteen conditions that can be used to judge whether trials with experimental technology are responsible. These conditions, however, were not yet translated into practical procedures, nor do they distinguish between the different types of AI applications and risk categories. This paper explores how those conditions could be further specified into procedures that could help facilitate and organize responsible experiments with AI, while differentiating for the different types of AI applications based on their level of automation. The four procedures that we propose are 1) A process of gradual testing 2) Risk- and side-effect detection 3) Explainability and severity, and 4) Democratic oversight. These procedures can be used by researchers, review boards, and research institutions to responsibly experiment with AI interventions in educational settings.

Date: 2024-06-25
New Economics Papers: this item is included in nep-ain and nep-exp
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/667c641bf112ce01d18a66e8/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:3dynw

DOI: 10.31219/osf.io/3dynw

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().