Research Commentary ---Generalizability of Information Systems Research Using Student Subjects---A Reflection on Our Practices and Recommendations for Future Research

Deborah Compeau (), Barbara Marcolin (), Helen Kelley () and Chris Higgins ()
Additional contact information
Deborah Compeau: Ivey Business School, Western University, London, Ontario N6A 3K7, Candada
Barbara Marcolin: Ivey Business School, Western University and Kinek Technologies Inc., London, Ontario N6A 3K7, Canada
Helen Kelley: Faculty of Management, University of Lethbridge, Lethbridge, Alberta T1K 3M4, Canada
Chris Higgins: Ivey Business School, Western University, London, Ontario N6A 3K7, Canada

Information Systems Research, 2012, vol. 23, issue 4, 1093-1109

Abstract: Information systems researchers, like those in many other disciplines in the social sciences, have debated the value and appropriateness of using students as research subjects. This debate appears in several articles that have been published on the subject as well as in the review process. In this latter arena, however, the debate has become increasingly like a script---the actors (authors and reviewers) simply read their parts of the script; some avoid the underlying issues whereas others cursorily address generalizability without real consideration of those issues. As a result, despite the extent of debate, we seem no closer to a resolution. Authors who use student subjects rely on their scripted arguments to justify the use of student subjects and do not always consider whether those arguments are valid. But reviewers who oppose the use of student subjects are equally culpable. They, too, rely on scripted arguments to criticize work using student subjects, and do not always consider whether those arguments are salient to the particular study. By presenting and reviewing one version of this script in the context of theoretical discussions of generalizability, we hope to demonstrate its limitations so that we can move beyond these scripted arguments into a more meaningful discussion. To do this, we review empirical studies from the period 1990--2010 to examine the extent to which student subjects are being used in the field and to critically assess the discussions within the field about the use of student samples. We conclude by presenting recommendations for authors and reviewers, for determining whether the use of students is appropriate in a particular context, and for presenting and discussing work that uses student subjects.

Keywords: external validity; student samples; review process (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (31)

Downloads: (external link)
http://dx.doi.org/10.1287/isre.1120.0423 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:orisre:v:23:y:2012:i:4:p:1093-1109

Access Statistics for this article

More articles in Information Systems Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().