Collaborative Majority Vote: Improving Result Quality in Crowdsourcing Marketplaces

Dennis Nordheimer (), Khrystyna Nordheimer (), Martin Schader () and Axel Korthaus ()
Additional contact information
Dennis Nordheimer: University of Mannheim, Schloss
Khrystyna Nordheimer: University of Mannheim, Schloss
Martin Schader: University of Mannheim, Schloss
Axel Korthaus: Victoria University International

A chapter in Crowdsourcing, 2015, pp 131-142 from Springer

Abstract: Abstract Crowdsourcing markets, such as Amazon’s Mechanical Turk, are designed for easy distribution of micro-tasks to an on-demand scalable workforce. Improving the quality of the submitted results is still one of the main challenges for quality control management in these markets. Although beneficial effects of synchronous collaborationSynchronous collaboration on the quality of work are well-established in other domains, interaction and collaboration mechanismsCollaboration mechanism are not yet supported by most crowdsourcing platforms, and thus, not considered as a means of ensuring high-quality processing of tasks. In this paper, we address this challenge and present a new method that extends majority vote, one of the most widely used quality assurance mechanisms, enabling workers to interact and communicate during task execution. We illustrate how to apply this method to the basic scenarios of task execution and present the enabling technology for the proposed real-time collaborative extension. We summarize its positive impacts on the quality of results and discuss its limitations.

Keywords: Crowdsourcing Marketplaces; Improve Result Quality; Real-time Collaboration; Quality Assurance Mechanisms; Extend Majority Voting (search for similar items in EconPapers)
Date: 2015
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prochp:978-3-662-47011-4_8

Ordering information: This item can be ordered from
http://www.springer.com/9783662470114

DOI: 10.1007/978-3-662-47011-4_8

Access Statistics for this chapter

More chapters in Progress in IS from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().