Identifying Expertise to Extract the Wisdom of Crowds

David V. Budescu () and Eva Chen ()
Additional contact information
David V. Budescu: Department of Psychology, Fordham University, Bronx, New York 10458
Eva Chen: University of Pennsylvania, Philadelphia, Pennsylvania 19104

Management Science, 2015, vol. 61, issue 2, 267-280

Abstract: Statistical aggregation is often used to combine multiple opinions within a group. Such aggregates outperform individuals, including experts, in various prediction and estimation tasks. This result is attributed to the “wisdom of crowds.” We seek to improve the quality of such aggregates by eliminating poorly performing individuals from the crowd. We propose a new measure of contribution to assess the judges' performance relative to the group and use positive contributors to build a weighting model for aggregating forecasts. In Study 1, we analyze 1,233 judges forecasting almost 200 current events to illustrate the superiority of our model over unweighted models and models weighted by measures of absolute performance. In Study 2, we replicate our findings by using economic forecasts from the European Central Bank and show how the method can be used to identify smaller crowds of the top positive contributors. We show that the model derives its power from identifying experts who consistently outperform the crowd.Data, as supplemental material, are available at http://dx.doi.org/10.1287/mnsc.2014.1909 . This paper was accepted by James Smith, decision analysis .

Keywords: wisdom of the crowd; forecasting; dynamic modeling; contribution (search for similar items in EconPapers)
Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (52)

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.2014.1909 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:61:y:2015:i:2:p:267-280

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().