EconPapers    
Economics at your fingertips  
 

Generation Next: Experimentation with AI

Gary Charness, Brian Jabarian and John List

Artefactual Field Experiments from The Field Experiments Website

Abstract: We investigate the potential for Large Language Models (LLMs) to enhance scientific practice within experimentation by identifying key areas, directions, and implications. First, we discuss how these models can improve experimental design, including improving the elicitation wording, coding experiments, and producing documentation. Second, we discuss the implementation of experiments using LLMs, focusing on enhancing causal inference by creating consistent experiences, improving comprehension of instructions, and monitoring participant engagement in real time. Third, we highlight how LLMs can help analyze experimental data, including pre-processing, data cleaning, and other analytical tasks while helping reviewers and replicators investigate studies. Each of these tasks improves the probability of reporting accurate findings. Finally, we recommend a scientific governance blueprint that manages the potential risks of using LLMs for experimental research while promoting their benefits. This could pave the way for open science opportunities and foster a culture of policy and industry experimentation at scale.

Date: 2023
New Economics Papers: this item is included in nep-ain and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://s3.amazonaws.com/fieldexperiments-papers2/papers/00777.pdf

Related works:
Working Paper: Generation Next: Experimentation with AI (2023) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:feb:artefa:00777

Access Statistics for this paper

More papers in Artefactual Field Experiments from The Field Experiments Website
Bibliographic data for series maintained by Francesca Pagnotta ().

 
Page updated 2025-03-30
Handle: RePEc:feb:artefa:00777