The Effect of Data Sampling on the Performance Evaluation of Artificial Neural Networks in Medical Diagnosis

Georgia D. Tourassi and Carey E. Floyd
Additional contact information
Georgia D. Tourassi: Address correspondence and reprint requests to Dr. Tourassi Department of Diagnostic Radiology, University of Louisville Hospital, Louisville, KY 40202

Medical Decision Making, 1997, vol. 17, issue 2, 186-192

Abstract: Purpose. To study the effect of data sampling on the predictive assessment of artificial neural networks (ANNs) for medical diagnostic tasks. Methods. Three statistical techniques were used to evaluate the diagnostic performances of ANNs: 1) cross validation, 2) round robin, and 3) bootstrap. These techniques are different sampling plans designed to reduce the small-sample estimation bias and variance contributions. The study was based on two networks, one developed for the diagnosis of pulmonary embolism (1,064 cases) and the other developed for the diagnosis of breast cancer (206 cases). Results. The three sampling techniques produced different performance estimates for both networks. The estimates varied substantially depending on the training sample size and the training-stopping criterion. Conclusion. The predictive assessment of ANNs in medical diagnosis can vary substantially based on the complexity of the problem, the data sampling technique, and the number of cases available. Key words: computer-aided diagnosis; artificial neural networks; sampling; cross validation; round robin; bootstrap; receiver operating characteristic analysis. (Med Decis Making 1997;17:186-192)

Date: 1997
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X9701700209 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:17:y:1997:i:2:p:186-192

DOI: 10.1177/0272989X9701700209

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().