A Bayesian Method for Studying DIF: A Cautionary Tale Filled With Surprises and Delights

Xiaohui Wang, Eric T. Bradlow, Howard Wainer and Eric S. Muller

Journal of Educational and Behavioral Statistics, 2008, vol. 33, issue 3, 363-384

Abstract: In the course of screening a form of a medical licensing exam for items that function differentially (DIF) between men and women, the authors used the traditional Mantel-Haenszel (MH) statistic for initial screening and a Bayesian method for deeper analysis. For very easy items, the MH statistic unexpectedly often found DIF where there was none. The Bayesian method did not lead the results astray. In this article, the authors describe one possible Bayesian approach for the study of DIF, illustrate its use on this data set, demonstrate situations in which the MH test can be misleading, explore these issues through a sequence of simulation studies, and offer a plausible explanation and advice for those who wish to study DIF.

Keywords: DIF; Mantel-Haenszel; Bayesian method; testlet (search for similar items in EconPapers)
Date: 2008
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998607306080 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:33:y:2008:i:3:p:363-384

DOI: 10.3102/1076998607306080

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().