Learning from Mixed Signals in Online Innovation Communities

Christoph Riedl and Victor P. Seidel ()
Additional contact information
Victor P. Seidel: F.W. Olin Graduate School of Business, Babson College, Babson Park, Massachusetts 02457; Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138; Said Business School, University of Oxford, Oxford OX1 1HP, United Kingdom

Organization Science, 2018, vol. 29, issue 6, 1010-1032

Abstract: We study how contributors to innovation contests improve their performance through direct experience and by observing others as they synthesize learnable signals from different sources. Our research draws on a 10-year panel of more than 55,000 individuals participating in a firm-hosted online innovation community sponsoring creative t-shirt design contests. Our data set contains almost 180,000 submissions that reflect signals of direct performance evaluation from both the community and the firm. Our data set also contains almost 150 million ratings that reflect signals for learning from observing the completed work of others. We have three key findings. First, we find a period of initial investment with decreased performance. This is because individuals struggle to synthesize learnable signals from early performance evaluation. This finding is contrary to other studies that report faster learning from early direct experience when improvements are easiest to achieve. Second, we find that individuals consistently improve their performance from observing others’ good examples. However, whether they improve from observing others’ bad examples depends on their ability to correctly recognize that work as being of low quality. Third, we find that individuals can successfully integrate signals about what is valued by the firm hosting the community, not just about what is valued by the community. We thus provide important insights into the mechanisms of how individuals learn in crowdsourced innovation and provide important qualifications for the often-heralded theme of “learning from failures.”

Keywords: innovation; crowdsourcing; online communities; contests; learning; knowledge (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://doi.org/10.1287/orsc.2018.1219 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ororsc:v:29:y:2018:i:6:p:1010-1032

Access Statistics for this article

More articles in Organization Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().