Reinforcement Learning-Based Routing Protocols in Flying Ad Hoc Networks (FANET): A Review

Jan Lansky, Saqib Ali, Amir Masoud Rahmani (), Mohammad Sadegh Yousefpoor, Efat Yousefpoor, Faheem Khan () and Mehdi Hosseinzadeh
Additional contact information
Jan Lansky: Department of Computer Science and Mathematics, Faculty of Economic Studies, University of Finance and Administration, 101 00 Prague, Czech Republic
Saqib Ali: Department of Information Systems, College of Economics and Political Science, Sultan Qaboos University, Al Khoudh, Muscat P.C.123, Oman
Amir Masoud Rahmani: Future Technology Research Center, National Yunlin University of Science and Technology, Yunlin, Douliou 64002, Taiwan
Mohammad Sadegh Yousefpoor: Department of Computer Engineering, Dezful Branch, Islamic Azad University, Dezful 5716963896, Iran
Efat Yousefpoor: Department of Computer Engineering, Dezful Branch, Islamic Azad University, Dezful 5716963896, Iran
Faheem Khan: Department of Computer Engineering, Gachon University, Seongnam 13120, Korea
Mehdi Hosseinzadeh: Mental Health Research Center, Psychosocial Health Research Institute, Iran University of Medical Sciences, Tehran 1449614535, Iran

Mathematics, 2022, vol. 10, issue 16, 1-60

Abstract: In recent years, flying ad hoc networks have attracted the attention of many researchers in industry and universities due to easy deployment, proper operational costs, and diverse applications. Designing an efficient routing protocol is challenging due to unique characteristics of these networks such as very fast motion of nodes, frequent changes of topology, and low density. Routing protocols determine how to provide communications between drones in a wireless ad hoc network. Today, reinforcement learning (RL) provides powerful solutions to solve the existing problems in the routing protocols, and designs autonomous, adaptive, and self-learning routing protocols. The main purpose of these routing protocols is to ensure a stable routing solution with low delay and minimum energy consumption. In this paper, the reinforcement learning-based routing methods in FANET are surveyed and studied. Initially, reinforcement learning, the Markov decision process (MDP), and reinforcement learning algorithms are briefly described. Then, flying ad hoc networks, various types of drones, and their applications, are introduced. Furthermore, the routing process and its challenges are briefly explained in FANET. Then, a classification of reinforcement learning-based routing protocols is suggested for the flying ad hoc networks. This classification categorizes routing protocols based on the learning algorithm, the routing algorithm, and the data dissemination process. Finally, we present the existing opportunities and challenges in this field to provide a detailed and accurate view for researchers to be aware of the future research directions in order to improve the existing reinforcement learning-based routing algorithms.

Keywords: flying ad hoc networks (FANET); reinforcement learning (RL); routing; artificial intelligence (AI); unmanned ariel vehicles (UAVs) (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/16/3017/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/16/3017/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:16:p:3017-:d:894229

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().