Condition-based maintenance for multi-state systems with prognostic and deep reinforcement learning

Huixian Zhang, Xiukun Wei, Zhiqiang Liu, Yaning Ding and Qingluan Guan

Reliability Engineering and System Safety, 2025, vol. 255, issue C

Abstract: The utilization of prognostic information in practical engineering is increasing with the development of technology and predictive modeling. Current research on maintenance strategies for complex multi-state systems often neglects prognostic information or assumes complete availability of all component information. This paper investigates the joint maintenance strategies based on condition-based maintenance for complex multi-state systems, in which the predicted remaining useful life of some components is known. Firstly, a maintenance strategy framework is developed and the joint maintenance strategy is proposed for the studied problem. Then the deterioration process of the component, the imperfect maintenance, and prediction error models are constructed. The optimization problem is modeled as a Markov Decision Process to minimize the maintenance cost, and the system reliability constraints are established by using the universal generating function method. In addition, a deep Q-network is designed to solve the optimal maintenance policy. Finally, the traction system of a metro train is taken as an example to verify the applicability of the model and algorithm. The results show that the proposed maintenance strategy reduces the maintenance cost compared to the current maintenance strategy for both fixed maintenance intervals and dynamic maintenance intervals.

Keywords: Multi-state system; Prognostic information; Condition-based maintenance; Deep reinforcement learning; Maintenance strategy optimization (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832024007300
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:255:y:2025:i:c:s0951832024007300

DOI: 10.1016/j.ress.2024.110659

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().