PAOLTransformer: Pruning-adaptive optimal lightweight Transformer model for aero-engine remaining useful life prediction

Xin Zhang, Jiankai Sun, Jiaxu Wang, Yulin Jin, Lei Wang and Zhiwen Liu

Reliability Engineering and System Safety, 2023, vol. 240, issue C

Abstract: Aero-engines are core equipment in aerospace field, and their remaining useful life (RUL) prediction is a critical aspect in spacecraft monitoring and maintenance. Transformer model demonstrates remarkable performance in this domain, but its construction heavily relies on a sizeable number of parameters and the excessive model redundancy may adversely affect its prediction performance. To address this issue, a pruning-adaptive optimal lightweight Transformer (PAOLTransformer) is proposed. The method employs norm information to evaluate the contribution of each element within the model to the outputs and subsequently utilizes structured pruning to eliminate unimportant redundant elements. The pruning procedure is executed automatically by seeking out the optimal compression rate via reinforcement learning with a reward score combining the accuracy and efficiency of RUL prediction. Experimental analysis on the C-MAPSS aero-engine dataset shows that PAOLTransformer significantly improves the performance metrics, including a 7% reduction in prediction error and a 33% reduction in computational complexity compared to the standard Transformer. It follows that the proposed model can achieve an optimal equilibrium between model performance and pruning rate. Furthermore, PAOLTransformer outperforms several advanced models in predicting long and complex time series. Therefore, this study holds significant implications for the implementation of preventive maintenance strategies for aero-engines.

Keywords: Remaining useful life prediction; Transformer; Lightweight deep learning model; Aero-engine; Adaptive structured pruning; Reinforcement learning (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832023005197
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:240:y:2023:i:c:s0951832023005197

DOI: 10.1016/j.ress.2023.109605

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().