An Optimization Method of Large-Scale Video Stream Concurrent Transmission for Edge Computing

Haitao Liu, Qingkui Chen () and Puchen Liu
Additional contact information
Haitao Liu: Business School, University of Shanghai for Science and Technology, Shanghai 200093, China
Qingkui Chen: Business School, University of Shanghai for Science and Technology, Shanghai 200093, China
Puchen Liu: Department of Applied Statistics, Shanghai Polytechnic University, Shanghai 201209, China

Mathematics, 2023, vol. 11, issue 12, 1-20

Abstract: Concurrent access to large-scale video data streams in edge computing is an important application scenario that currently faces a high cost of network access equipment and high data packet loss rate. To solve this problem, a low-cost link aggregation video stream data concurrent transmission method is proposed. Data Plane Development Kit (DPDK) technology supports the concurrent receiving and forwarding function of multiple Network Interface Cards (NICs). The Q-learning data stream scheduling model is proposed to solve the load scheduling of multiple queues of multiple NICs. The Central Processing Unit (CPU) transmission processing unit was dynamically selected by data stream classification, as well as a reward function, to achieve the dynamic load balancing of data stream transmission. The experiments conducted demonstrate that this method expands the bandwidth by 3.6 times over the benchmark scheme for a single network port, and reduces the average CPU load ratio by 18%. Compared to the UDP and DPDK schemes, it lowers the average system latency by 21%, reduces the data transmission packet loss rate by 0.48%, and improves the overall system transmission throughput. This transmission optimization scheme can be applied in data centers and edge computing clusters to improve the communication performance of big data processing.

Keywords: edge computing; multi-network port parallelism; link aggregation; Q-learning; load balancing; DPDK (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/12/2622/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/12/2622/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:12:p:2622-:d:1166745

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().