Separation-like irregularity and sample size optimism in high-discrimination logistic prediction models

Ye Liang, Louis Shuo Wang, Jiguang Yu and Xin Zan

PLOS ONE, 2026, vol. 21, issue 8, 1-36

Abstract: Closed-form minimum sample size criteria for developing logistic prediction models, such as the Riley framework implemented in pmsampsize, are widely used but may become optimistic when anticipated discrimination is high. We conducted a Monte Carlo simulation study to compare the formula-based recommended development sample size, nRiley, with an empirical required sample size, nreq, defined by out-of-sample calibration-slope stability under repeated development sampling. Scenarios fixed the candidate parameter dimension at p = 10 and crossed predictor distribution (normal, standardized skewed continuous, binary), signal density (dense versus sparse), prevalence (ϕ∈{0.05,0.10,0.20}), and target discrimination (AUCtarget∈{0.70,0.75,0.80,0.85,0.90}), with intercept and signal strength calibrated to match targets. We defined nreq as the smallest n such that 𝔼(bn)≥0.90 and Pr(bn

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0342286 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 42286&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0342286

DOI: 10.1371/journal.pone.0342286

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().