Neural-transformer: A brain-inspired lightweight mechanical fault diagnosis method under noise

Changdong Wang, Bowen Tian, Jingli Yang, Huamin Jie, Yongqi Chang and Zhenyu Zhao

Reliability Engineering and System Safety, 2024, vol. 251, issue C

Abstract: Recently, as a representative of deep learning methods, Transformers have shown great prowess in intelligent fault diagnosis, offering powerful feature extraction and modeling. However, their high computational demand and low robustness limit industrial application. Therefore, this paper proposes an innovative Neural-Transformer to realize high-precision robust fault diagnosis with low computational cost. First, a two-dimensional representation method, the frequency-slice wavelet transform (FSWT), is introduced to reflect the dynamic characteristics and frequency component variations of signals, enhancing the fault identifiability of vibration signals. Second, a separable multiscale spiking tokenizer (SMST) is developed to project time-frequency input of multiple scales to spike features with a fixed patch, ensuring consistency in feature extraction and improving the recognizability of specific frequencies in mechanical faults. Subsequently, a multi-head spatiotemporal spiking self-attention (MHSSSA) mechanism is constructed, which abandons the cumbersome multiplication operations with high computational costs and can also focus on key fine-grained time-frequency features in a global range. Experimental cases validate the advantages of the Neural-Transformer in comparison to baseline methods and state-of-art methods on one public dataset and two real-world datasets. In particular, the proposed method only consumes 0.65mJ of energy to achieve an optimal diagnostic accuracy of 93.14% on real-world dataset.

Keywords: Deep learning; Lightweight; Mechanical fault diagnosis; Spiking neural networks; Transformer (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832024004812
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:251:y:2024:i:c:s0951832024004812

DOI: 10.1016/j.ress.2024.110409

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().