Condition-based maintenance for redundant systems considering spare inventory with stochastic lead time

Jun Wang, Yuqiang Fu, Jian Zhou, Lechang Yang and Yating Yang

Reliability Engineering and System Safety, 2025, vol. 257, issue PA

Abstract: Condition-based maintenance (CBM) and spare provisioning are both important to guarantee the operation of redundant systems composed of degrading components. However, most existing studies on joint optimization of CBM and spare inventory assume maintenance actions are instantaneous and the lead time for spares are fixed, which are not consistent with the reality. Therefore, this paper focus on the joint optimization problems to minimize the total cost rate considering stochastic maintenance time for components and stochastic lead time for spares. The problem is modeled as a Markov decision process model and solved by an improved reinforcement learning algorithm, i.e., the improved Q-learning algorithm, which converges more quickly and reaches a smaller value of the total cost rate than the traditional Q-learning algorithm. Moreover, the simulated environment based on discrete event simulation method is introduced in detail and the convergence of the algorithm is proved theoretically. Based on the numerical study, we further demonstrate the convergence and effectiveness of the proposed algorithm and perform sensitivity analysis on several model parameters to provide management insights for decision makers.

Keywords: Condition-based maintenance; Spare inventory; Stochastic lead time; Improved reinforcement learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832025000407
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:257:y:2025:i:pa:s0951832025000407

DOI: 10.1016/j.ress.2025.110837

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().