 Is natural language processing the cheap charlie of analyzing cheap talk? A horse race between classifiers on experimental communication dataEva Tebbe and Benjamin Wegener Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), 2022, vol. 96, issue C Abstract: We conduct a horse race between various classification algorithms in order to assess whether some algorithms might be more appropriate for classifying experimental communication data than others. We use data reported by various experimental studies involving digital written communication. The effectiveness criterion for comparing the algorithms is based on the agreement between human message-codings and classifications generated by the respective text classification approaches. Our results show that Gradient Boosting Machines are a good choice for separating empty talk from relevant talk messages. This holds (1) independent of the training set size, (2) when the ratio of empty talk to relevant talk is low, and (3) when there are not only two, but three message classes. Keywords: Laboratory experiments; Communication; Cheap talk; Classification of natural language messages; Machine learning (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:soceco:v:96:y:2022:i:c:s2214804321001488 DOI: 10.1016/j.socec.2021.101808 Access Statistics for this article Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) is currently edited by Pablo Brañas Garza More articles in Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.