Cooperative Guidance Strategy for Active Spacecraft Protection from a Homing Interceptor via Deep Reinforcement Learning

Weilin Ni, Jiaqi Liu, Zhi Li, Peng Liu and Haizhao Liang ()
Additional contact information
Weilin Ni: School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzheng 518107, China
Jiaqi Liu: National Key Laboratory of Science and Technology on Test Physics and Numerical Mathematics, Beijing 100076, China
Zhi Li: School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzheng 518107, China
Peng Liu: National Key Laboratory of Science and Technology on Test Physics and Numerical Mathematics, Beijing 100076, China
Haizhao Liang: School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzheng 518107, China

Mathematics, 2023, vol. 11, issue 19, 1-25

Abstract: The cooperative active defense guidance problem for a spacecraft with active defense is investigated in this paper. An engagement between a spacecraft, an active defense vehicle, and an interceptor is considered, where the target spacecraft with active defense will attempt to evade the interceptor. Prior knowledge uncertainty and observation noise are taken into account simultaneously, which are vital for traditional guidance strategies such as the differential-game-based guidance method. In this set, we propose an intelligent cooperative active defense (ICAAI) guidance strategy based on deep reinforcement learning. ICAAI effectively coordinates defender and target maneuvers to achieve successful evasion with less prior knowledge and observational noise. Furthermore, we introduce an efficient and stable convergence (ESC) training approach employing reward shaping and curriculum learning to tackle the sparse reward problem in ICAAI training. Numerical experiments are included to demonstrate ICAAI’s real-time performance, convergence, adaptiveness, and robustness through the learning process and Monte Carlo simulations. The learning process showcases improved convergence efficiency with ESC, while simulation results illustrate ICAAI’s enhanced robustness and adaptiveness compared to optimal guidance laws.

Keywords: cooperative guidance; reinforcement learning; active protection; guidance law (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/19/4211/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/19/4211/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:19:p:4211-:d:1256037

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().