Reinforcement Learning for Mitigating Malware Propagation in Wireless Radar Sensor Networks with Channel Modeling

Guiyun Liu, Hao Li, Lihao Xiong, Yiduan Chen (), Aojing Wang () and Dongze Shen
Additional contact information
Guiyun Liu: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
Hao Li: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
Lihao Xiong: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
Yiduan Chen: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
Aojing Wang: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
Dongze Shen: School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China

Mathematics, 2025, vol. 13, issue 9, 1-30

Abstract: With the rapid development of research on Wireless Radar Sensor Networks (WRSNs), security issues have become a major challenge. Recent studies have highlighted numerous security threats in WRSNs. Given their widespread application value, the operational security of WRSNs needs to be ensured. This study focuses on the problem of malware propagation in WRSNs. In this study, the complex characteristics of WRSNs are considered to construct the epidemic VCISQ model. The model incorporates necessary factors such as node density, Rayleigh fading channels, and time delay, which were often overlooked in previous studies. This model achieves a breakthrough in accurately describing real-world scenarios of malware propagation in WRSNs. To control malware spread, a hybrid control strategy combining quarantine and patching measures are introduced. In addition, the optimal control method is used to minimize control costs. Considering the robustness and adaptability of the control method, two model-free reinforcement learning (RL) strategies are proposed: Proximal Policy Optimization (PPO) and Multi-Agent Proximal Policy Optimization (MAPPO). These strategies reformulate the original optimal control problem as a Markov decision process. To demonstrate the superiority of our approach, multi-dimensional ablation studies and numerical experiments are conducted. The results show that the hybrid control strategy outperforms single strategies in suppressing malware propagation and reducing costs. Furthermore, the experiments reveal the significant impact of time delays on the dynamics of the VCISQ model and control effectiveness. Finally, the PPO and MAPPO algorithms demonstrate superior performance in control costs and convergence compared to traditional RL algorithms. This highlights their effectiveness in addressing malware propagation in WRSNs.

Keywords: wireless radar sensor networks (WRSNs); channel modeling; malware propagation; reinforcement learning (RL) (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/9/1397/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/9/1397/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:9:p:1397-:d:1641799

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().