Research on robot path tracking method based on IDDPG-MPC

Haicheng Shen, Xun Xu and Zhiqiang Miao

PLOS ONE, 2026, vol. 21, issue 7, 1-24

Abstract: In complex marine environments, path-following control of unmanned surface vessels (USVs) faces numerous challenges, including environmental disturbances, dynamic nonlinearities, and underactuated systems. To overcome the limitations of traditional line-of-sight/PID control in terms of robustness and adaptability, this study proposes a hybrid control architecture combining improved deep deterministic policy gradient (IDDPG) and model predictive control (MPC). The IDDPG algorithm, as the upper-level decision-making module, utilizes deep reinforcement learning to generate optimal heading angle increment commands by learning the environmental state. The MPC, as the lower-level execution module, optimizes control variables such as thrust and rudder angle through rolling optimization based on the USV’s three-degree-of-freedom nonlinear dynamics model. This study constructs a closed-loop “perception-decision-execution-learning” paradigm and employs gradient pruning and a customized reward function to ensure the stability of algorithm training and the optimality of control decisions. Lateral deviation and heading angle error are used as evaluation metrics to verify the control performance. Simulation results show that this method effectively solves the adaptability challenge of traditional control strategies in complex environments. Compared with the traditional ALOS-PID method, the average lateral deviation is reduced by 37% and the heading angle error is reduced by 21%, thus realizing high-precision path tracking control for unmanned surface vessels and providing a new method for autonomous surface vehicle navigation.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0350307 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 50307&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0350307

DOI: 10.1371/journal.pone.0350307

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().