The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content

Roman Lukyanenko (), Jeffrey Parsons () and Yolanda F. Wiersma ()
Additional contact information
Roman Lukyanenko: College of Business, Florida International University, Miami, Florida 33199
Jeffrey Parsons: Faculty of Business Administration, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada
Yolanda F. Wiersma: Department of Biology, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada

Information Systems Research, 2014, vol. 25, issue 4, 669-689

Abstract: User-generated content (UGC) is becoming a valuable organizational resource, as it is seen in many cases as a way to make more information available for analysis. To make effective use of UGC, it is necessary to understand information quality (IQ) in this setting. Traditional IQ research focuses on corporate data and views users as data consumers. However, as users with varying levels of expertise contribute information in an open setting, current conceptualizations of IQ break down. In particular, the practice of modeling information requirements in terms of fixed classes, such as an Entity-Relationship diagram or relational database tables, unnecessarily restricts the IQ of user-generated data sets. This paper defines crowd information quality (crowd IQ), empirically examines implications of class-based modeling approaches for crowd IQ, and offers a path for improving crowd IQ using instance-and-attribute based modeling. To evaluate the impact of modeling decisions on IQ, we conducted three experiments. Results demonstrate that information accuracy depends on the classes used to model domains, with participants providing more accurate information when classifying phenomena at a more general level. In addition, we found greater overall accuracy when participants could provide free-form data compared to a condition in which they selected from constrained choices. We further demonstrate that, relative to attribute-based data collection, information loss occurs when class-based models are used. Our findings have significant implications for information quality, information modeling, and UGC research and practice.

Keywords: systems design and implementation; laboratory experiments; information quality; conceptual modeling; crowdsourcing; social media; citizen science; user-generated content (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (15)

Downloads: (external link)
http://dx.doi.org/10.1287/isre.2014.0537 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:orisre:v:25:y:2014:i:4:p:669-689

Access Statistics for this article

More articles in Information Systems Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().