Sensitivity of Survival Analysis Metrics

Iulii Vasilev (), Mikhail Petrovskiy () and Igor Mashechkin ()
Additional contact information
Iulii Vasilev: Computer Science Department, Lomonosov Moscow State University, Vorobjovy Gory, 119899 Moscow, Russia
Mikhail Petrovskiy: Computer Science Department, Lomonosov Moscow State University, Vorobjovy Gory, 119899 Moscow, Russia
Igor Mashechkin: Computer Science Department, Lomonosov Moscow State University, Vorobjovy Gory, 119899 Moscow, Russia

Mathematics, 2023, vol. 11, issue 20, 1-34

Abstract: Survival analysis models allow for predicting the probability of an event over time. The specificity of the survival analysis data includes the distribution of events over time and the proportion of classes. Late events are often rare and do not correspond to the main distribution and strongly affect the quality of the models and quality assessment. In this paper, we identify four cases of excessive sensitivity of survival analysis metrics and propose methods to overcome them. To set the equality of observation impacts, we adjust the weights of events based on target time and censoring indicator. According to the sensitivity of metrics, A U P R C (area under Precision-Recall curve) is best suited for assessing the quality of survival models, and other metrics are used as loss functions. To evaluate the influence of the loss function, the B a g g i n g model uses ones to select the size and hyperparameters of the ensemble. The experimental study included eight real medical datasets. The proposed modifications of I B S (Integrated Brier Score) improved the quality of B a g g i n g compared to the classical loss functions. In addition, in seven out of eight datasets, the B a g g i n g with new loss functions outperforms the existing models of the scikit-survival library.

Keywords: machine learning; survival analysis; Kaplan–Meier estimator; recursive partitioning; model averaging (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/20/4246/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/20/4246/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:20:p:4246-:d:1257599

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().