Selecting Workers Wisely for Crowdsourcing When Copiers and Domain Experts Co-exist

Xiu Fang, Suxin Si, Guohao Sun, Quan Z. Sheng, Wenjun Wu, Kang Wang and Hang Lv
Additional contact information
Xiu Fang: School of Computer Science and Technology, Donghua University, Shanghai 201600, China
Suxin Si: School of Computer Science and Technology, Donghua University, Shanghai 201600, China
Guohao Sun: School of Computer Science and Technology, Donghua University, Shanghai 201600, China
Quan Z. Sheng: School of Computing, Macquaire University, Sydney, NSW 2109, Australia
Wenjun Wu: School of Computer Science and Technology, Donghua University, Shanghai 201600, China
Kang Wang: School of Computer Science and Technology, Donghua University, Shanghai 201600, China
Hang Lv: School of Computer Science and Technology, Donghua University, Shanghai 201600, China

Future Internet, 2022, vol. 14, issue 2, 1-22

Abstract: Crowdsourcing integrates human wisdom to solve problems. Tremendous research efforts have been made in this area. However, most of them assume that workers have the same credibility in different domains and workers complete tasks independently. This leads to an inaccurate evaluation of worker credibility, hampering crowdsourcing results. To consider the impact of worker domain expertise, we adopted a vector to more accurately measure the credibility of each worker. Based on this measurement and prior task domain knowledge, we calculated fine-grained worker credibility on each given task. To avoid tasks being assigned to dependent workers who copy answers from others, we conducted copier detection via Bayesian analysis. We designed a crowdsourcing system called SWWC composed of a task assignment stage and a truth discovery stage. In the task assignment stage, we assigned tasks wisely to workers based on worker domain expertise calculation and copier removal. In the truth discovery stage, we computed the estimated truth and worker credibility by an iterative method. Then, we updated the domain expertise of workers to facilitate the upcoming task assignment. We also designed initialization algorithms to better initialize the accuracy of new workers. Theoretical analysis and experimental results showed that our method had a prominent advantage, especially under a copying situation.

Keywords: crowdsourcing; task assignment; truth discovery; domain; copier (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/14/2/37/pdf (application/pdf)
https://www.mdpi.com/1999-5903/14/2/37/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:14:y:2022:i:2:p:37-:d:732274

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().