A novel transformer-based few-shot learning method for intelligent fault diagnosis with noisy labels under varying working conditions

Haoyu Wang, Chuanjiang Li, Peng Ding, Shaobo Li, Tandong Li, Chenyu Liu, Xiangjie Zhang and Zejian Hong

Reliability Engineering and System Safety, 2024, vol. 251, issue C

Abstract: Recent years have witnessed the success of Few-shot Learning (FSL) methods in equipment reliability enhancement and fault diagnosis, by virtue of learning from limited data and adapting to new operating conditions. However, due to sensor bias, manual collection, and mislabeling, label noise is inevitably introduced into the dataset, which further reduces the quality of supervised information contained in the few-shot dataset, posing significant challenges for accurate fault diagnosis. In this paper, the problem of Few-shot Fault Diagnosis with Noisy Labels (FFDNL) is studied for the first time, and a novel method named Enhanced Transformer with Asymmetric Loss Function (ETALF) is proposed. ETALF leverages the self-attention mechanism of the transformer to dynamically measure the similarity between fault samples in the support set to enhance the model's robustness against label noise, then naturally aggregates the similar samples into corresponding correct prototypes. Furthermore, an asymmetric loss function is designed, which adaptively assigns the model with larger penalties for incorrect category predictions and smaller penalties for correct category predictions, thereby enhancing fault diagnostic performance through inherent asymmetry. Comprehensive experiments are conducted on two benchmark datasets, and the compared results with representative approaches validate the effectiveness of our proposed ETALF in performing intelligent fault diagnosis using limited and noise-labeled data under varying working conditions, which achieves accuracies of 97.77% and 95.78% with 0.2 noisy-level labels during meta-training and meta-testing on the CWRU and KAIST datasets, respectively.

Keywords: Few-shot learning; Noisy label; Intelligent fault diagnosis; Transformer; Asymmetric loss function (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832024004721
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:251:y:2024:i:c:s0951832024004721

DOI: 10.1016/j.ress.2024.110400

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().