Resampling-Based Inference Methods for Comparing Two Coefficients Alpha

Markus Pauly (), Maria Umlauft and Ali Ünlü
Additional contact information
Markus Pauly: Ulm University
Maria Umlauft: Ulm University
Ali Ünlü: Technical University of Munich

Psychometrika, 2018, vol. 83, issue 1, No 10, 203-222

Abstract: Abstract The two-sample problem for Cronbach’s coefficient $$\alpha _C$$ α C , as an estimate of test or composite score reliability, has attracted little attention compared to the extensive treatment of the one-sample case. It is necessary to compare the reliability of a test for different subgroups, for different tests or the short and long forms of a test. In this paper, we study statistical procedures of comparing two coefficients $$\alpha _{C,1}$$ α C , 1 and $$\alpha _{C,2}$$ α C , 2 . The null hypothesis of interest is $$H_0 : \alpha _{C,1} = \alpha _{C,2}$$ H 0 : α C , 1 = α C , 2 , which we test against one-or two-sided alternatives. For this purpose, resampling-based permutation and bootstrap tests are proposed for two-group multivariate non-normal models under the general asymptotically distribution-free (ADF) setting. These statistical tests ensure a better control of the type-I error, in finite or very small sample sizes, when the state-of-affairs ADF large-sample test may fail to properly attain the nominal significance level. By proper choice of a studentized test statistic, the resampling tests are modified in order to be valid asymptotically even in non-exchangeable data frameworks. Moreover, extensions of this approach to other designs and reliability measures are discussed as well. Finally, the usefulness of the proposed resampling-based testing strategies is demonstrated in an extensive simulation study and illustrated by real data applications.

Keywords: bootstrap; coefficient alpha; Cronbach’s alpha; non-normality; permutation; reliability; resampling-based inference (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11336-017-9601-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:psycho:v:83:y:2018:i:1:d:10.1007_s11336-017-9601-x

Ordering information: This journal article can be ordered from
http://www.springer. ... gy/journal/11336/PS2

DOI: 10.1007/s11336-017-9601-x

Access Statistics for this article

Psychometrika is currently edited by Irini Moustaki

More articles in Psychometrika from Springer, The Psychometric Society
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().