Deep and handcrafted features from clinical images combined with patient information for skin cancer diagnosis

Carlos Frederico S. da F. Mendes and Renato A. Krohling

Chaos, Solitons & Fractals, 2022, vol. 162, issue C

Abstract: Skin lesions diagnostic is a challenging problem due to the variety of visual aspects of the lesions. The clinical analysis of skin lesions relies on the visual information as well as on the complementary information provided by the patient. Since dermatologists make use of visual cues and patient clinical information, we investigate if the combination of features from convolutional neural networks (CNN), handcrafted features and patient clinical information can improve the performance of automated diagnosis of skin cancer. Most works on skin lesion diagnosis in the literature use dermoscopic images without patient clinical information. In order to address this problem, we used a clinical image dataset of skin lesions with patient information collected via smartphone named PAD-UFES-20. With the proposed fusion architecture we show that the results using clinical features as a complement to the CNN and handcrafted features improve the classification in terms of balanced accuracy by 7.1 % for cancer and by 3.2 % for melanoma as compared with only features extracted from a CNN. In addition, our findings show that combining only handcrafted features with deep features did not improve the results, indicating the importance of using clinical metadata for skin lesion classification.

Keywords: Skin cancer diagnosis; Clinical images; Patient information; Feature fusion; Deep learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077922006555
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:162:y:2022:i:c:s0960077922006555

DOI: 10.1016/j.chaos.2022.112445

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().