Glider soaring via reinforcement learning in the field

Gautam Reddy, Jerome Wong-Ng, Antonio Celani, Terrence J. Sejnowski and Massimo Vergassola ()
Additional contact information
Gautam Reddy: University of California, San Diego
Jerome Wong-Ng: University of California, San Diego
Antonio Celani: The Abdus Salam International Center for Theoretical Physics
Terrence J. Sejnowski: The Salk Institute for Biological Studies
Massimo Vergassola: University of California, San Diego

Nature, 2018, vol. 562, issue 7726, 236-239

Abstract: Abstract Soaring birds often rely on ascending thermal plumes (thermals) in the atmosphere as they search for prey or migrate across large distances1–4. The landscape of convective currents is rugged and shifts on timescales of a few minutes as thermals constantly form, disintegrate or are transported away by the wind5,6. How soaring birds find and navigate thermals within this complex landscape is unknown. Reinforcement learning7 provides an appropriate framework in which to identify an effective navigational strategy as a sequence of decisions made in response to environmental cues. Here we use reinforcement learning to train a glider in the field to navigate atmospheric thermals autonomously. We equipped a glider of two-metre wingspan with a flight controller that precisely controlled the bank angle and pitch, modulating these at intervals with the aim of gaining as much lift as possible. A navigational strategy was determined solely from the glider’s pooled experiences, collected over several days in the field. The strategy relies on on-board methods to accurately estimate the local vertical wind accelerations and the roll-wise torques on the glider, which serve as navigational cues. We establish the validity of our learned flight policy through field experiments, numerical simulations and estimates of the noise in measurements caused by atmospheric turbulence. Our results highlight the role of vertical wind accelerations and roll-wise torques as effective mechanosensory cues for soaring birds and provide a navigational strategy that is directly applicable to the development of autonomous soaring vehicles.

Keywords: Bank Angle; Vertical Wind Velocity; Mechanosensory Cues; Flight Controller; Thermal Soaring (search for similar items in EconPapers)
Date: 2018
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.nature.com/articles/s41586-018-0533-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nature:v:562:y:2018:i:7726:d:10.1038_s41586-018-0533-0

Ordering information: This journal article can be ordered from
https://www.nature.com/

DOI: 10.1038/s41586-018-0533-0

Access Statistics for this article

Nature is currently edited by Magdalena Skipper

More articles in Nature from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().