Nonparametric Limits of Agreement in Method Comparison Studies: A Simulation Study on Extreme Quantile Estimation

Oke Gerke
Additional contact information
Oke Gerke: Department of Nuclear Medicine, Odense University Hospital, 5000 Odense C, Denmark

IJERPH, 2020, vol. 17, issue 22, 1-14

Abstract: Bland–Altman limits of agreement and the underlying plot are a well-established means in method comparison studies on quantitative outcomes. Normally distributed paired differences, a constant bias, and variance homogeneity across the measurement range are implicit assumptions to this end. Whenever these assumptions are not fully met and cannot be remedied by an appropriate transformation of the data or the application of a regression approach, the 2.5% and 97.5% quantiles of the differences have to be estimated nonparametrically. Earlier, a simple Sample Quantile (SQ) estimator (a weighted average of the observations closest to the target quantile), the Harrell–Davis estimator (HD), and estimators of the Sfakianakis–Verginis type (SV) outperformed 10 other quantile estimators in terms of mean coverage for the next observation in a simulation study, based on sample sizes between 30 and 150. Here, we investigate the variability of the coverage probability of these three and another three promising nonparametric quantile estimators with n = 50 ( 50 ) 200 , 250 ( 250 ) 1000 . The SQ estimator outperformed the HD and SV estimators for n = 50 and was slightly better for n = 100 , whereas the SQ, HD, and SV estimators performed identically well for n ≥ 150 . The similarity of the boxplots for the SQ estimator across both distributions and sample sizes was striking.

Keywords: agreement; Bland–Altman analysis; coverage; limits of agreement; method comparison; quantile estimation; repeatability; reproducibility (search for similar items in EconPapers)
JEL-codes: I I1 I3 Q Q5 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1660-4601/17/22/8330/pdf (application/pdf)
https://www.mdpi.com/1660-4601/17/22/8330/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jijerp:v:17:y:2020:i:22:p:8330-:d:443069

Access Statistics for this article

IJERPH is currently edited by Ms. Jenna Liu

More articles in IJERPH from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().