Estimator of Agreement with Covariate Adjustment

Katelyn A. McKenzie () and Jonathan D. Mahnken
Additional contact information
Katelyn A. McKenzie: The University of Kansas Medical Center
Jonathan D. Mahnken: The University of Kansas Medical Center

Journal of Agricultural, Biological and Environmental Statistics, 2024, vol. 29, issue 1, No 2, 19-35

Abstract: Abstract The parameter $$\kappa $$ κ is a general agreement structure used across many fields, such as medicine, machine learning and the pharmaceutical industry. A popular estimator for $$\kappa $$ κ is Cohen’s $$\kappa $$ κ ; however, this estimator does not account for multiple influential factors. The primary goal of this paper is to propose an estimator of agreement for a binary response using a logistic regression framework. We use logistic regression to estimate the probability of a positive evaluation while adjusting for factors. These predicted probabilities are then used to calculate expected agreement. It is shown that ignoring needed adjustment measures, as in Cohen’s $$\kappa $$ κ , leads to an inflated estimate of $$\kappa $$ κ and a situation similar to Simpson’s paradox. Simulation studies verified mathematical relationships and confirmed estimates are inflated when necessary covariates are left unadjusted. Our method was applied to an Alzheimer’s disease neuroimaging study. The proposed approach allows for inclusion of both categorical and continuous covariates, includes Cohen’s $$\kappa $$ κ as a special case, offers an alternative interpretation, and is easily implemented in standard statistical software.

Keywords: Alzheimer’s disease; Cohen’s $$\kappa $$ κ; Generalized linear model; Simpson’s paradox (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s13253-023-00553-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jagbes:v:29:y:2024:i:1:d:10.1007_s13253-023-00553-2

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/13253

DOI: 10.1007/s13253-023-00553-2

Access Statistics for this article

Journal of Agricultural, Biological and Environmental Statistics is currently edited by Stephen Buckland

More articles in Journal of Agricultural, Biological and Environmental Statistics from Springer, The International Biometric Society, American Statistical Association
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().