Mission Possible: The Collection of High-Quality Data

Can Celebi, Christine Exley, Soren Harrs, Hannu Kivimaki, Marta Serra-Garcia and Jeffrey Yusof

No 12535, CESifo Working Paper Series from CESifo

Abstract: Absent high-quality online data, research questions would be constrained conceptually and in study populations. To inform the debate about online data quality, this paper provides empirical evidence that compares data quality of responses from online participants, AI agents, and human subjects in the lab. Corresponding results reveal high data quality on some platforms, but not others. This paper also highlights a viable path for high-quality online data in an evolving landscape: use a two-stage recruitment method to broadly recruit online subjects in a baseline study and then limit recruitment for the main study to the resulting subset of "high quality" subjects.

Keywords: experiments; data quality; AI agents; AI (search for similar items in EconPapers)
JEL-codes: C81 C83 C90 O33 (search for similar items in EconPapers)
Date: 2026
New Economics Papers: this item is included in nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.ifo.de/DocDL/cesifo1_wp12535.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ces:ceswps:_12535

Access Statistics for this paper

More papers in CESifo Working Paper Series from CESifo Contact information at EDIRC.
Bibliographic data for series maintained by Klaus Wohlrabe ().