Adjusting Response Style in Work Engagement Scores in Japan ―Using the Anchoring Vignette Method and a Multidimensional IRT Model―

Mao Sawada () and Hiroya Hirakimoto ()
Additional contact information
Mao Sawada: Graduate School of Economics, The University of Osaka
Hiroya Hirakimoto: Graduate School of Economics, The University of Osaka

No 26-12, Discussion Papers in Economics and Business from Osaka University, Graduate School of Economics

Abstract: This study aimed to quantitatively examine the extent to which response style (RS) — a bias arising at the time of responding and previously discussed as a possible source of cultural bias — contributes to the internationally low work engagement (WE) scores of Japanese workers. A questionnaire survey was conducted with 442 regular employees recruited through an internet survey company. The survey included three items from the Ultra-Short Measure of the Utrecht Work Engagement Scale (UWES) and six anchoring vignette items. Bayesian analysis using a multidimensional item response theory model combined with the anchoring vignette method was employed to estimate a model controlling for respondents' RS. The results showed that, although model comparison suggested the presence of RS effects, no RS of meaningful magnitude was identified for nearly all respondents, and RS did not substantively affect their WE scores. Furthermore, the correction effect from controlling for RS was extremely small at 0.013 points, representing only 1.3% of the approximately one-point difference reported in previous international comparisons. The effect size (Cohen's d = 0.010) was also negligible. These findings suggest that the low WE scores in Japan are difficult to explain by RS, and that other potential influences — including biases that depend on item content, as well as job characteristics and the work environment — warrant further examination.

Keywords: Work Engagement; Utrecht Work Engagement Scale; Response Style; Anchoring Vignette Method; Multidimensional IRT Model (search for similar items in EconPapers)
JEL-codes: J24 J28 O15 (search for similar items in EconPapers)
Pages: 18 pages
Date: 2026-09
New Economics Papers: this item is included in nep-sea
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www2.econ.osaka-u.ac.jp/econ_society/dp/2612.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osk:wpaper:2612

Access Statistics for this paper

More papers in Discussion Papers in Economics and Business from Osaka University, Graduate School of Economics Contact information at EDIRC.
Bibliographic data for series maintained by The Economic Society of Osaka University ().