From Helping Hand to Stumbling Block: The ChatGPT Paradox in Competency Experiment

Duk Gyoo Kim and Ahram Moon

No 11002, CESifo Working Paper Series from CESifo

Abstract: We ran a controlled laboratory experiment to examine whether ChatGPT’s aid can increase the participants’ performance in three different—reading and writing, mathematical problem-solving, and computational thinking—tasks. We find that the math score significantly decreases with ChatGPT’s assistance. This result is mainly because the low-ability subjects couldn’t discern the hallucinated answers with the correct ones, and it contests the general idea that ChatGPT can complement the workers with less expertise.

Keywords: laboratory experiment; ChatGPT; labor productivity (search for similar items in EconPapers)
JEL-codes: C91 D83 J24 O33 (search for similar items in EconPapers)
Date: 2024
New Economics Papers: this item is included in nep-ain, nep-exp and nep-lma
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.cesifo.org/DocDL/cesifo1_wp11002.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ces:ceswps:_11002

Access Statistics for this paper

More papers in CESifo Working Paper Series from CESifo Contact information at EDIRC.
Bibliographic data for series maintained by Klaus Wohlrabe ().