12 Best Practices for Leveraging Generative AI in Experimental Research

Samuel Chang, Andrew Kennedy, Aaron Leonard and John List

No 33025, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: We provide twelve best practices and discuss how each practice can help researchers accurately, credibly, and ethically use Generative AI (GenAI) to enhance experimental research. We split the twelve practices into four areas. First, in the pre-treatment stage, we discuss how GenAI can aid in pre-registration procedures, data privacy concerns, and ethical considerations specific to GenAI usage. Second, in the design and implementation stage, we focus on GenAI’s role in identifying new channels of variation, piloting and documentation, and upholding the four exclusion restrictions. Third, in the analysis stage, we explore how prompting and training set bias can impact results as well as necessary steps to ensure replicability. Finally, we discuss forward-looking best practices that are likely to gain importance as GenAI evolves.

JEL-codes: C9 C90 C91 C92 C93 (search for similar items in EconPapers)
Date: 2024-10
New Economics Papers: this item is included in nep-exp
Note: CH DEV ED LS PE
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.nber.org/papers/w33025.pdf (application/pdf)
Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.

Related works:
Working Paper: 12 Best Practices for Leveraging Generative AI in Experimental Research (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:33025

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w33025
The price is Paper copy available by mail.

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().