Multi-Objective Path Planning for Unmanned Sweepers Considering Traffic Signals: A Reinforcement Learning-Enhanced NSGA-II Approach

Yiwen Huang, Wenjia Mou, Juncong Lan, Fuhai Luo, Kai Wu and Shaofeng Lu ()
Additional contact information
Yiwen Huang: Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China
Wenjia Mou: Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China
Juncong Lan: Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China
Fuhai Luo: Fulongma Group Co., Ltd., 42 Longteng South Road, Xinluo District, Longyan 364000, China
Kai Wu: Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China
Shaofeng Lu: Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China

Sustainability, 2024, vol. 16, issue 24, 1-19

Abstract: With the widespread popularization of unmanned sweepers, path planning has been recognized as a key component affecting their total work efficiency. Conventional path planning methods often only aim to improve work efficiency while ignoring energy optimization, a crucial factor for sustainable development. In this paper, an energy- and time-minimization unmanned sweeper arc path problem (ETM-ARP) is investigated, and the effects of road slope, dynamic changes in on-board mass, mode switching of vehicle work, and traffic lights are taken into consideration to meet the requirements of a realistic structured road scenario. A new multi-objective mixed-integer nonlinear planning model is proposed for this problem. To solve this model, we propose a deep Q-network (DQN) and Adaptive Large Neighborhood Search Algorithm (ALNS)-driven non-dominated sorting genetic algorithm II (QALNS-NSGA-II). The novelty of this algorithm lies in integrating DQN into ALNS, to guide high-quality adaptive operator selection during the search process based on additional information. The computational results of various examples confirm the effectiveness of the proposed method. The proposed method can be used to improve the efficiency and sustainability of unmanned sweepers for sweeping on structured roads.

Keywords: unmanned sweeper; path planning; multi-objective optimization; DQN (search for similar items in EconPapers)
JEL-codes: O13 Q Q0 Q2 Q3 Q5 Q56 (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2071-1050/16/24/11297/pdf (application/pdf)
https://www.mdpi.com/2071-1050/16/24/11297/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jsusta:v:16:y:2024:i:24:p:11297-:d:1550812

Access Statistics for this article

Sustainability is currently edited by Ms. Alexandra Wu

More articles in Sustainability from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().