Deep multi-modal fusion network with gated unit for breast cancer survival prediction

Han Yuan and Hongzhen Xu

Computer Methods in Biomechanics and Biomedical Engineering, 2024, vol. 27, issue 7, 883-896

Abstract: Accurate survival prediction is a critical goal in the prognosis of breast cancer patients because it can help physicians make more patient-friendly decisions and further guide appropriate treatment. Breast cancer is often caused by genetic abnormalities, which prompts researchers to consider information such as gene expression and copy number variation in addition to clinical data in their studies. The integration of these multi-modal data can improve the predictive power of models. However, with the highly unbalanced information of breast cancer patient data, it becomes a new challenge for breast cancer patient survival prediction to fully extract the characteristic information of these multi-modal data and to consider the complementarity of this information. To this end, we propose a deep multi-modal fusion network (DMMFN) to predict the five-year survival of breast cancer patients by integrating clinical data, copy number variation data, and gene expression data. The imbalanced dataset is first processed using the oversampling method SMOTE-NC. Then the abstract modal features of the multi-modal data are extracted by the two-layer one-dimensional convolutional neural network and the bi-directional long short-term memory network. Next, the weight coefficients of each modal data are dynamically adjusted using gated multimodal units to obtain fusion features. Finally, the fusion features are fed into the MaxoutMLP classifier to obtain the final prediction results. We conducted experiments on the METABRIC dataset to verify the validity of the multi-modal data and compared it with other methods. The comprehensive performance evaluation shows that DMMFN has better prediction performance.

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/10255842.2023.2211188 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:gcmbxx:v:27:y:2024:i:7:p:883-896

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/gcmb20

DOI: 10.1080/10255842.2023.2211188

Access Statistics for this article

Computer Methods in Biomechanics and Biomedical Engineering is currently edited by Director of Biomaterials John Middleton

More articles in Computer Methods in Biomechanics and Biomedical Engineering from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().