The detection and influence of problematic item content in ability tests: An examination of sensitivity review practices for personnel selection test development

James A. Grand, Juliya Golubovich, Ann Marie Ryan and Neal Schmitt

Organizational Behavior and Human Decision Processes, 2013, vol. 121, issue 2, 158-173

Abstract: In organizational and educational practices, sensitivity reviews are commonly advocated techniques for reducing test bias and enhancing fairness. In the present paper, results from two studies are reported which investigate how effective individuals are at detecting problematic test content and the influence such content has on important testing outcomes. In Study 1, signal detection analyses are used to examine the role of individual differences in the identification of insensitive test items, while Study 2 investigates the extent to which insensitivity differentially influences item performance and reactions. Results revealed small but significant differences in the overall accuracy and response tendencies of student test reviewers on the basis of demographics and key individual differences variables. Contrary to predictions however, problematic items did not exhibit differential item functioning across sex nor did their presence engender negative test taker reactions. Implications and suggestions for future research and sensitivity review practices are discussed.

Keywords: Sensitivity review; Fairness review; Test review; Signal detection analysis; Test bias; Test development; Differential item functioning; Selection; Assessment (search for similar items in EconPapers)
Date: 2013
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0749597813000228
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jobhdp:v:121:y:2013:i:2:p:158-173

DOI: 10.1016/j.obhdp.2013.01.009

Access Statistics for this article

Organizational Behavior and Human Decision Processes is currently edited by John M. Schaubroeck

More articles in Organizational Behavior and Human Decision Processes from Elsevier
Bibliographic data for series maintained by Catherine Liu ().