A dynamic mission abort policy for transportation systems with stochastic dependence by deep reinforcement learning

Lujie Liu, Jun Yang and Bingxin Yan

Reliability Engineering and System Safety, 2024, vol. 241, issue C

Abstract: The mission abort policy is considered an effective approach for managing operational risks in transportation systems, which are typically equipped with mission payloads to perform designated tasks. However, existing research mainly focuses on the impact of component failures on system survivability while neglecting situations where the system only experiences functional failures. Additionally, the stochastic dependence between components is always neglected. To address the above problems, a dynamic mission abort method is developed. First, a mission abort policy is proposed to consider the stochastic dependence and mission payload, and the specific mission abort action is determined based on the health state of components and the time in the mission. Next, to maximize the expected cumulative reward during the mission, a dynamic mission abort decision-making model is established based on the Markov decision process. Then, to address the dimensionality curse caused by a continuous state space, a customized deep reinforcement learning method is developed, where the parameter sharing technique is used to reduce the model parameters of the network. Finally, the effectiveness of the proposed method is verified through a numerical example of a reconnaissance UAV, and the superiority of the proposed method is demonstrated by comparing it with heuristic policies.

Keywords: Mission abort; Multi-component systems; Stochastic dependence; Functional failure; Deep reinforcement learning; Markov decision process (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832023005963
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:241:y:2024:i:c:s0951832023005963

DOI: 10.1016/j.ress.2023.109682

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().