Fleet planning under demand and fuel price uncertainty using actor–critic reinforcement learning

Izaak L. Geursen, Bruno F. Santos and Neil Yorke-Smith

Journal of Air Transport Management, 2023, vol. 109, issue C

Abstract: Current state-of-the-art airline planning models face computational limitations, restricting the operational applicability to problems of representative sizes. This is particularly the case when considering the uncertainty necessarily associated with the long-term plan of an aircraft fleet. Considering the growing interest in the application of machine learning techniques to operations research problems, this article investigates the applicability of these techniques for airline planning. Specifically, an Advantage Actor–Critic (A2C) reinforcement learning algorithm is developed for the airline fleet planning problem. The increased computational efficiency of using an A2C agent allows us to consider real-world-sized problems and account for highly-volatile uncertainty in demand and fuel price. The result is a multi-stage probabilistic fleet plan describing the evolution of the fleet according to a large set of future scenarios. The A2C algorithm is found to outperform a deterministic model and a deep Q-network algorithm. The relative performance of the A2C increases as more complexity is added to the problem. Further, the A2C algorithm can compute a multi-stage fleet planning solution within a few seconds.

Keywords: Airline fleet planning; Stochastic optimisation; Reinforcement learning; Advantage Actor–Critic; Fuel price uncertainty (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0969699723000406
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jaitra:v:109:y:2023:i:c:s0969699723000406

DOI: 10.1016/j.jairtraman.2023.102397

Access Statistics for this article

Journal of Air Transport Management is currently edited by Anne Graham

More articles in Journal of Air Transport Management from Elsevier
Bibliographic data for series maintained by Catherine Liu ().