12 Best Practices for Leveraging Generative AI in Experimental Research

Samuel Chang, Andrew Kennedy, Aaron Leonard and John List

Artefactual Field Experiments from The Field Experiments Website

Abstract: We provide twelve best practices and discuss how each practice can help researchers accurately, credibly, and ethically use Generative AI (GenAI) to enhance experimental research. We split the twelve practices into four areas. First, in the pre-treatment stage, we discuss how GenAI can aid in pre-registration procedures, data privacy concerns, and ethical considerations specific to GenAI usage. Second, in the design and implementation stage, we focus on GenAI's role in identifying new channels of variation, piloting and documentation, and upholding the four exclusion restrictions. Third, in the analysis stage, we explore how prompting and training set bias can impact results as well as necessary steps to ensure replicability. Finally, we discuss forward-looking best practices that are likely to gain importance as GenAI evolves.

Date: 2024
New Economics Papers: this item is included in nep-ain, nep-exp and nep-ipr
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://s3.amazonaws.com/fieldexperiments-papers2/papers/00796.pdf

Related works:
Working Paper: 12 Best Practices for Leveraging Generative AI in Experimental Research (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:feb:artefa:00796

Access Statistics for this paper

More papers in Artefactual Field Experiments from The Field Experiments Website
Bibliographic data for series maintained by Francesca Pagnotta ().