Using Deep Learning for Visual Navigation of Drone with Respect to 3D Ground Objects

Oleg Kupervasser, Hennadii Kutomanov, Ori Levi, Vladislav Pukshansky and Roman Yavich
Additional contact information
Oleg Kupervasser: Department of Mathematics, Ariel University, Ariel 4070000, Israel
Hennadii Kutomanov: Department of Mathematics, Ariel University, Ariel 4070000, Israel
Ori Levi: Department of Mathematics, Ariel University, Ariel 4070000, Israel
Vladislav Pukshansky: Department of Mathematics, Ariel University, Ariel 4070000, Israel
Roman Yavich: Department of Mathematics, Ariel University, Ariel 4070000, Israel

Mathematics, 2020, vol. 8, issue 12, 1-13

Abstract: In the paper, visual navigation of a drone is considered. The drone navigation problem consists of two parts. The first part is finding the real position and orientation of the drone. The second part is finding the difference between desirable and real position and orientation of the drone and creation of the correspondent control signal for decreasing the difference. For the first part of the drone navigation problem, the paper presents a method for determining the coordinates of the drone camera with respect to known three-dimensional (3D) ground objects using deep learning. The algorithm has two stages. It causes the algorithm to be easy for interpretation by artificial neural network (ANN) and consequently increases its accuracy. At the first stage, we use the first ANN to find coordinates of the object origin projection. At the second stage, we use the second ANN to find the drone camera position and orientation. The algorithm has high accuracy (these errors were found for the validation set of images as differences between positions and orientations, obtained from a pretrained artificial neural network, and known positions and orientations), it is not sensitive to interference associated with changes in lighting, the appearance of external moving objects and the other phenomena where other methods of visual navigation are not effective. For the second part of the drone navigation problem, the paper presents a method for stabilization of drone flight controlled by autopilot with time delay. Indeed, image processing for navigation demands a lot of time and results in a time delay. However, the proposed method allows to get stable control in the presence of this time delay.

Keywords: drone; vision-based navigation; visual navigation; machine learning; Alex-Net; quaternions; artificial neural network; deep learning convolution network; autopilot; time delay; stability of differential equations (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2020
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/8/12/2140/pdf (application/pdf)
https://www.mdpi.com/2227-7390/8/12/2140/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:8:y:2020:i:12:p:2140-:d:454563

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().