Operational readiness-oriented condition-based maintenance and spare parts optimization for multi-state systems

Shihan Tan, Qiwei Hu, Chiming Guo, Dunxiang Zhu, Enzhi Dong and Fang Zhang

Reliability Engineering and System Safety, 2025, vol. 264, issue PA

Abstract: In many military scenarios, engineered systems are required to remain satisfied with operational readiness to respond to unexpected tasks. However, the degradation caused by daily usage inherently decreases the operational readiness of these systems. Condition-based maintenance is an efficient strategy that can recover the system operational readiness by restoring the system condition. On the other hand, the activities of maintenance are often constrained by spare parts ordering. Most existing research only pays attention on the daily work and ignores the requirement of operational readiness. In this paper, a novel reinforcement learning (RL) based condition-based maintenance and spare parts optimization method for multiple unit multi-state systems (MSS) is proposed, aimed at minimizing long-term cost rate considering the requirement of operational readiness and daily work. The resulting joint decision-making problem is formulated as a discrete-time discrete-state Markov decision process (MDP) and a customized architecture of value iteration algorithm embedded with a stratified sampling Monte Carlo (SSMC) method is introduced. A real case of armored vehicles in a military base is provided to prove the effectiveness of our method. From comparative experiments and sensitivity analysis of serval examples, several interesting suggestions are presented.

Keywords: Condition-based maintenance (CBM); Multi-state system (MSS); Operational readiness; Spare parts ordering; Reinforcement learning (RL) (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S095183202500568X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:264:y:2025:i:pa:s095183202500568x

DOI: 10.1016/j.ress.2025.111367

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().