Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit
Yu Mo (mo-y20@mails.tsinghua.edu.cn),
Qianhui Wu (wuqianhui@tsinghua.org.cn),
Xiu Li (li.xiu@sz.tsinghua.edu.cn) and
Biqing Huang (hbq@tsinghua.edu.cn)
Additional contact information
Yu Mo: Tsinghua University
Qianhui Wu: Tsinghua University
Xiu Li: Division of Information Science, Tsinghua Shenzhen International Graduate School
Biqing Huang: Tsinghua University
Journal of Intelligent Manufacturing, 2021, vol. 32, issue 7, No 14, 1997-2006
Abstract:
Abstract Remaining Useful Life (RUL) estimation is a fundamental task in the prognostic and health management (PHM) of industrial equipment and systems. To this end, we propose a novel approach for RUL estimation in this paper, based on deep neural architecture due to its great success in sequence learning. Specifically, we take the Transformer encoder as the backbone of our model to capture short- and long-term dependencies in a time sequence. Compared with convolutional neural network based methods, there is no limitation from the kernel size for a complete receptive field of all time steps. While compared with recurrent neural network based methods, we develop our model based on dot-product self-attention, enabling it to fully exploit parallel computation. Moreover, we further propose a gated convolutional unit to facilitate the model’s ability of incorporating local contexts at each time step, for the attention mechanism used in the Transformer encoder makes the output high-level features insensitive to local contexts. We conduct experiments on the C-MAPSS datasets and show that, the performance of our model is superior or comparable to those of other existing methods. We also carry out ablation studies and demonstrate the necessity and effectiveness of each component used in the proposed model.
Keywords: Remaining useful life estimation; Transformer encoder; Gated convolutional unit; Turbofan engine (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (26)
Downloads: (external link)
http://link.springer.com/10.1007/s10845-021-01750-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:32:y:2021:i:7:d:10.1007_s10845-021-01750-x
Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845
DOI: 10.1007/s10845-021-01750-x
Access Statistics for this article
Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak
More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla (sonal.shukla@springer.com) and Springer Nature Abstracting and Indexing (indexing@springernature.com).