Applying masked autoencoder-based self-supervised learning for high-capability vision transformers of electrocardiographies

Shinnosuke Sawano, Satoshi Kodera, Naoto Setoguchi, Kengo Tanabe, Shunichi Kushida, Junji Kanda, Mike Saji, Mamoru Nanasato, Hisataka Maki, Hideo Fujita, Nahoko Kato, Hiroyuki Watanabe, Minami Suzuki, Masao Takahashi, Naoko Sawada, Masao Yamasaki, Masataka Sato, Susumu Katsushika, Hiroki Shinohara, Norifumi Takeda, Katsuhito Fujiu, Masao Daimon, Hiroshi Akazawa, Hiroyuki Morita and Issei Komuro

PLOS ONE, 2024, vol. 19, issue 8, 1-17

Abstract: The generalization of deep neural network algorithms to a broader population is an important challenge in the medical field. We aimed to apply self-supervised learning using masked autoencoders (MAEs) to improve the performance of the 12-lead electrocardiography (ECG) analysis model using limited ECG data. We pretrained Vision Transformer (ViT) models by reconstructing the masked ECG data with MAE. We fine-tuned this MAE-based ECG pretrained model on ECG-echocardiography data from The University of Tokyo Hospital (UTokyo) for the detection of left ventricular systolic dysfunction (LVSD), and then evaluated it using multi-center external validation data from seven institutions, employing the area under the receiver operating characteristic curve (AUROC) for assessment. We included 38,245 ECG-echocardiography pairs from UTokyo and 229,439 pairs from all institutions. The performances of MAE-based ECG models pretrained using ECG data from UTokyo were significantly higher than that of other Deep Neural Network models across all external validation cohorts (AUROC, 0.913–0.962 for LVSD, p

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0307978 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 07978&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0307978

DOI: 10.1371/journal.pone.0307978

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().