Asymptotic analysis of reliability measures for an imperfect dichotomous test

Alla Slynko ()
Additional contact information
Alla Slynko: University of Waterloo

Statistical Papers, 2022, vol. 63, issue 4, No 1, 995-1012

Abstract: Abstract To access the reliability of a new dichotomous test and to capture the random variability of its results in the absence of a gold standard, two measures, the inconsistent acceptance probability (IAP) and inconsistent rejection probability (IRP), were introduced in the literature. In this paper, we first analyze the limiting behavior of both measures as the number of test repetitions increases and derive the corresponding accuracy estimates and rates of convergence. To overcome possible limitations of IRP and IAP, we then introduce a one-parameter family of refined reliability measures, $$\Delta (k, s)$$ Δ ( k , s ) . Such measures characterize the consistency of the results of a dichotomous test in the absence of a gold standard as the threshold for a positive aggregate test result varies. Similar to IRP and IAP, we also derive corresponding accuracy estimates and rates of convergence for $$\Delta (k, s)$$ Δ ( k , s ) as the number k of test repetitions increases.

Keywords: Dichotomous test; Inconsistent acceptance probability; Inconsistent rejection probability; Reliability measures; Testing without a gold standard; 62J15; 62F12 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-021-01266-9 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:63:y:2022:i:4:d:10.1007_s00362-021-01266-9

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-021-01266-9

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().