Optimizing Maintenance of Energy Supply Systems in City Logistics with Heuristics and Reinforcement Learning

Antoni Guerrero, Angel A. Juan (), Alvaro Garcia-Sanchez and Luis Pita-Romero
Additional contact information
Antoni Guerrero: Baobab Soluciones, Jose Abascal 55, 28003 Madrid, Spain
Angel A. Juan: Research Center on Production Management and Engineering, Universitat Politècnica de València, Plaza Ferrandiz-Carbonell, 03801 Alcoy, Spain
Alvaro Garcia-Sanchez: Department of Organization Engineering, Business Administration and Statistics, Universidad Politécnica de Madrid, Jose Abascal 2, 28006 Madrid, Spain
Luis Pita-Romero: Baobab Soluciones, Jose Abascal 55, 28003 Madrid, Spain

Mathematics, 2024, vol. 12, issue 19, 1-21

Abstract: In urban logistics, effective maintenance is crucial for maintaining the reliability and efficiency of energy supply systems, impacting both asset performance and operational stability. This paper addresses the scheduling and routing plans for maintenance of power generation assets over a multi-period horizon. We model this problem as a multi-period team orienteering problem. To address this multi-period challenge, we propose a dual approach: a novel reinforcement learning (RL) framework and a biased-randomized heuristic algorithm. The RL-based method dynamically learns from real-time operational data and evolving asset conditions, adapting to changes in asset health and failure probabilities to optimize decision making. In addition, we develop and apply a biased-randomized heuristic algorithm designed to provide effective solutions within practical computational limits. Our approach is validated through a series of computational experiments comparing the RL model and the heuristic algorithm. The results demonstrate that, when properly trained, the RL-based model is able to offer equivalent or even superior performance compared to the heuristic algorithm.

Keywords: optimization; energy supply systems; city logistics; team orienteering problem; biased-randomized algorithms; reinforcement learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/19/3140/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/19/3140/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:19:p:3140-:d:1493682

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().