Confidence intervals for an ordinal effect size measure based on partially validated series

Shi-Fang Qiu, Wai-Yin Poon and Man-Lai Tang

Computational Statistics & Data Analysis, 2016, vol. 103, issue C, 170-192

Abstract: An ordinal effect size measure is used to assess whether one variable is stochastically larger than the other; therefore, this measure is a useful means by which to describe the difference between two ordinal categorical distributions. In practical analysis, it is desirable to obtain data only by a gold standard test, but such tests are often limited due to high costs or ethical considerations, especially in medical research applications. However, misclassification can arise when a cheaper, faster, and/or non-invasive, but fallible test is used to collect data. The use of partially validated data obtained by double sampling has become a popular compromise between these two approaches. In this study, we develop twelve estimators of the confidence interval (CI) for an ordinal effect size measure based on partially validated data. The performance of the proposed CIs are evaluated by simulation studies in terms of the empirical coverage probability, the empirical coverage width, and the ratio of the mesial non-coverage probability and non-coverage probability. Simulation results show that the Wald CI on logit scale, the Bootstrap percentile CI and the Bias-corrected Bootstrap normal CI have outstanding performance even in small sample designs. When sample sizes are moderate, all CIs except the Wald, Bias-corrected Bootstrap percentile and logit-transformation-based Bootstrap percentile-t CIs demonstrate good coverage properties. Moreover, all CIs perform well when sample sizes are large. All methods are illustrated by analyzing a real data set from a research study of highway safety on automobile accidents.

Keywords: Bayesian credible interval; Bootstrap-resampling; Ordinal data with misclassification; Partially validated series (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947316301086
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:103:y:2016:i:c:p:170-192

DOI: 10.1016/j.csda.2016.05.006

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().