The Impact of Extreme Response Style on the Mean Comparison of Two Independent Samples

Yingbin Zhang, Zhaoxi Yang and Yehui Wang

SAGE Open, 2022, vol. 12, issue 2, 21582440221108168

Abstract: Extreme response style (ERS) is prevalent in survey research using rating scales. It may cause biased results in group comparisons. This research conducted two sets of simulation studies to explore the magnitude of the ERS impact on mean comparisons between two independent samples. Data were generated from a multidimensional nominal response model. Study 1 examined the influence of ERS on the estimate of group differences in the variable of interest. The results indicated that ERS led to biased estimates, especially when these groups differed significantly in ERS. The correlation between ERS and the variable of interest also moderated the ERS impact. The results were illustrated with an empirical example. Study 2 investigated the impact of ERS on the type I error and type II error in the independent t -test based on scale scores. When the variable of interest had no true difference between groups, ERS inflated the type I error rate . When the difference existed, ERS inflated the type II error rate . Two groups’ true difference in ERS and the variable of interest, unequal ERS variances, the correlation between ERS and the variable of interest, and the number of items moderated the impact of ERS on type I and II error rates. The implications for practices and further research are discussed.

Keywords: extreme response style; rating scale; mean comparison; independent t-test; multidimensional nominal response model (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/21582440221108168 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:sagope:v:12:y:2022:i:2:p:21582440221108168

DOI: 10.1177/21582440221108168

Access Statistics for this article

More articles in SAGE Open
Bibliographic data for series maintained by SAGE Publications ().