Transmission scheduling of P2P real-time communication based on restless multi-armed bandit

Ting Wu (), Shikun Tian () and Shengda Tang ()
Additional contact information
Ting Wu: School of Mathematics and Statistics in Guangxi Normal University
Shikun Tian: School of Mathematics and Statistics in Guangxi Normal University
Shengda Tang: School of Mathematics and Statistics in Guangxi Normal University

Telecommunication Systems: Modelling, Analysis, Design and Management, 2024, vol. 86, issue 2, No 4, 293 pages

Abstract: Abstract In this paper, we consider a transmission scheduling problem of the point-to-point (P2P) real-time communication over fading channel. Specifically, we assume each transmission task with a strict time delay arrives into the system randomly, we consider the transmission scheduling strategy under the time delay constraint of the communication system so as to maximize the total discounted expected reward of the system. The communication model is formulated in the framework of the Markov decision process (MDP), and since the curse of dimensionality of the proposed MDP architecture, the transmission scheduling problem is analyzed based on the restless multi-armed bandit process. We show the existence of the Whittle index of the P2P transmission communication, and based on which, the closed solution of Whittle index based transmission scheduling strategy is obtained. Finally, the numerical results are given to verify the availability of the Whittle index based transmission scheduling algorithm, and it is also shown that our proposed transmission scheduling algorithm is with low computational complexity, and it reduces the computational time greatly in comparison to the MDP method.

Keywords: P2P real-time communication system; Transmission scheduling strategy; Restless multi-armed bandit; Whittle index (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11235-024-01147-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:telsys:v:86:y:2024:i:2:d:10.1007_s11235-024-01147-0

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11235

DOI: 10.1007/s11235-024-01147-0

Access Statistics for this article

Telecommunication Systems: Modelling, Analysis, Design and Management is currently edited by Muhammad Khan

More articles in Telecommunication Systems: Modelling, Analysis, Design and Management from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().