Logistic regression withstands comparison with machine learning for thyroid nodule malignancy risk stratification under strict temporal validation
Juan Jesús Fernández Alba,
Florentino Carral San Laureano,
Ana Isabel Jiménez Millán and
Carmen González Macías
PLOS Digital Health, 2026, vol. 5, issue 11, 1-15
Abstract:
Ultrasound risk-stratification systems (ACR TI-RADS, EU-TIRADS, ATA 2015) guide fine-needle aspiration decisions for thyroid nodules but do not integrate clinical or biochemical information. Multivariable logistic regression (LR) models incorporating these variables provide individualised malignancy probability estimates, and machine learning (ML) algorithms have been proposed as potential improvements, but rigorous comparative evidence under temporal validation is scarce. We conducted a single-centre retrospective cohort study of 861 thyroidectomies (2010–2023), split chronologically (training: before 2019, n = 432, 94 malignant; test: 2019 onwards, n = 429, 92 malignant). An LR model using the specification of a previously published and externally validated model — with coefficients re-estimated in the training cohort — was compared head-to-head with Random Forest (RF), XGBoost (XGB), Bagged CART, and a multilayer perceptron (MLP) trained on the same predictors. Performance was assessed by discrimination (ROC-AUC and precision-recall AUC), calibration (Brier score, calibration slope and intercept), and clinical utility (decision curve analysis), with operating characteristics reported at the pre-specified 9.55% probability threshold. LR achieved an AUC of 0.838 (95% CI 0.789–0.884), closely matching the published external validation of the original model (0.84). RF (AUC 0.843, p = 0.76) and XGB (AUC 0.844, p = 0.69) were statistically indistinguishable from LR; Bagged CART (0.821, p = 0.40) was non-significantly inferior; the MLP (0.768, p
Date: 2026
References: Add references at CitEc
Citations:
Downloads: (external link)
https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001828 (text/html)
https://journals.plos.org/digitalhealth/article/fi ... 01828&type=printable (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:plo:pdig00:0001828
DOI: 10.1371/journal.pdig.0001828
Access Statistics for this article
More articles in PLOS Digital Health from Public Library of Science
Bibliographic data for series maintained by digitalhealth ().