Multi-user reinforcement learning based multi-reward for spectrum access in cognitive vehicular networks

Lingling Chen (), Quanjun Zhao, Ke Fu, Xiaohui Zhao and Hongliang Sun
Additional contact information
Lingling Chen: Jilin Institute of Chemical Technology
Quanjun Zhao: Jilin Institute of Chemical Technology
Ke Fu: Jilin Institute of Chemical Technology
Xiaohui Zhao: Jilin University
Hongliang Sun: Jilin Institute of Chemical Technology

Telecommunication Systems: Modelling, Analysis, Design and Management, 2023, vol. 83, issue 1, No 5, 65 pages

Abstract: Abstract Cognitive Vehicular Networks (CVNs) can improve spectrum utilization by intelligently using idle spectrum, so as to fulfill the needs of communication. The previous researches only considered vehicle-to-vehicle(V2V) links or vehicle-to-infrastructure (V2I) links and ignored the influence of spectrum sensing errors. Therefore, in this paper, V2V links and V2I links are simultaneously discussed in the presence of spectrum sensing errors in the CVNs communication environment that we establish, and a dynamic spectrum access problem aiming at spectrum utilization is framed. In order to solve the above problems, the reinforcement learning method is introduced in this paper. But the impact of two kinds of collisions on the spectrum access rate of cognitive vehicles is neglected in the reinforcement learning method, and the above collisions which exist between cognitive vehicles, between cognitive vehicles and primary vehicles. Hence, different reward functions are designed according to different collision situations, and an improved reinforcement learning method is utilized to improve the success probability of spectrum access. To verify the effectiveness of the improved method, the performance and convergence of the proposed method are significantly better than other methods by comparing with the Myopic method, DQN and traditional DDQN in Python.

Keywords: Cognitive Vehicular Networks; Dynamic spectrum access; Vehicle-to-vehicle links; Vehicle-to-infrastructure links; Spectrum sensing errors (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11235-023-01004-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:telsys:v:83:y:2023:i:1:d:10.1007_s11235-023-01004-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11235

DOI: 10.1007/s11235-023-01004-6

Access Statistics for this article

Telecommunication Systems: Modelling, Analysis, Design and Management is currently edited by Muhammad Khan

More articles in Telecommunication Systems: Modelling, Analysis, Design and Management from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().