Extracting the Wisdom from the Crowd: A Comparison of Approaches to Aggregating Collective Intelligence

Thomas Görzen () and Florian Laux ()
Additional contact information
Thomas Görzen: University of Paderborn
Florian Laux: University of Paderborn

No 56, Working Papers Dissertations from Paderborn University, Faculty of Business Administration and Economics

Abstract: To benefit from crowdsourcing, companies are increasingly required to employ mechanisms for aggregating the multiple opinions generated in this process. Scholars have raised concerns, however, about the currently most popular method used for this purpose - majority-voting. We conduct two studies to compare different aggregation methods and measure their performance. While the first study aims to generate a general understanding of the aggregating approaches by asking general knowledge questions, the second study is employed in the context of idea evaluation. Moreover, by differentiating between different levels of question difficulty or idea quality respectively, we find that the average-confidence approach i) provides the highest percentage of correctly identified answers across different categories of general knowledge questions and ii) is better suited to identify high quality ideas. Our findings both extend the existing literature on aggregation approaches used for collective intelligence and offer practical insights. Since we use a crowd on a commercial crowdsourcing platform, our results offer valuable insights for companies using or planning to use a crowd for collective intelligence.\\

Keywords: Crowdsourcing; collective intelligence; wisdom of the crowd; aggregation approaches (search for similar items in EconPapers)
JEL-codes: C93 L86 M55 O32 (search for similar items in EconPapers)
Pages: 19
Date: 2019-06
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://groups.uni-paderborn.de/wp-wiwi/RePEc/pdf/dispap/DP56.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pdn:dispap:56

Access Statistics for this paper

More papers in Working Papers Dissertations from Paderborn University, Faculty of Business Administration and Economics Contact information at EDIRC.
Bibliographic data for series maintained by WP-WiWi-Info ().