MACA: Multi-Agent with Credit Assignment for Computation Offloading in Smart Parks Monitoring

Liang She, Jianyuan Wang (), Yifan Bo and Yangyan Zeng ()
Additional contact information
Liang She: School of Computer Science and Engineering, Central South University, Changsha 410083, China
Jianyuan Wang: School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
Yifan Bo: School of Computer Science and Engineering, Beihang University, Beijing 100191, China
Yangyan Zeng: School of Frontier Crossover Studies, Hunan University of Technology and Business, Changsha 410205, China

Mathematics, 2022, vol. 10, issue 23, 1-18

Abstract: Video monitoring has a wide range of applications in a variety of scenarios, especially in smart parks. How to improve the efficiency of video data processing and reduce resource consumption have become of increasing concern. The high complexity of traditional computation offloading algorithms makes it difficult to apply them to real-time decision-making scenarios. Thus, we propose a multi-agent deep reinforcement learning algorithm with credit assignment (MACA) for computation offloading in smart park monitoring. By making online decisions after offline training, the agent can give consideration to both decision time and accuracy in effectively solving the problem of the curse of dimensionality. Via simulation, we compare the performance of MACA with traditional deep Q-network reinforcement learning algorithm and other methods. Our results show that MACA performs better in scenarios where there are a higher number of agents and can minimize request delay and reduce task energy consumption. In addition, we also provide results from a generalization capability verified experiment and ablation study, which demonstrate the contribution of MACA algorithm to each component.

Keywords: computation offloading; deep reinforcement learning; credit assignment; multi-agent; video monitoring (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/23/4616/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/23/4616/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:23:p:4616-:d:994697

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().