Prioritized experience replay based reinforcement learning for adaptive tracking control of autonomous underwater vehicle

Ting Li, Dongsheng Yang and Xiangpeng Xie

Applied Mathematics and Computation, 2023, vol. 443, issue C

Abstract: A novel adaptive trajectory tracking control method is proposed in this paper for autonomous underwater vehicle systems with external disturbances. The control action is composed of sliding mode control and action-depended heuristic dynamic programming (ADHDP) controller to track the expected sailing position and angle in the horizontal coordinate system with fixed depth. As an auxiliary control of sliding mode control, the ADHDP controller observes the difference between the actual sailing position/angle and the expected sailing position/angle, and adaptively provides corresponding supplementary control actions using a data-driven fashion. At the same time, we design a weight-related priority experience replay (PER) technology to update the online weight network by using the relevant historical data stored in the database to improve the learning rate. The proposed algorithm can adjust parameters online under various conditions. Furthermore, it is very suitable for underwater vehicle systems with parameter uncertainties and external disturbances. Based on Lyapunov stability method, the stability of closed-loop system state and network weight error is analyzed. Finally, the validity of our control strategy is verified by simulation.

Keywords: Adaptive dynamic programming; Tracking control; Disturbances; Data-driven; Experience replay; Autonomous underwater vehicle (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0096300322008025
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:apmaco:v:443:y:2023:i:c:s0096300322008025

DOI: 10.1016/j.amc.2022.127734

Access Statistics for this article

Applied Mathematics and Computation is currently edited by Theodore Simos

More articles in Applied Mathematics and Computation from Elsevier
Bibliographic data for series maintained by Catherine Liu ().