Integral reinforcement learning-based guaranteed cost control for unknown nonlinear systems subject to input constraints and uncertainties

Yuling Liang, Huaguang Zhang, Juan Zhang and Yanhong Luo

Applied Mathematics and Computation, 2021, vol. 408, issue C

Abstract: This paper investigates guaranteed cost control (GCC) problem for nonlinear systems subject to input constraints and disturbances by utilizing the reinforcement-learning (RL) algorithm. Firstly, by establishing a modified Hamilton–Jacobi–Bellman (HJI) equation, which is difficult to be solved, a model-based policy iteration (PI) GCC algorithm is designed for input-constrained nonlinear systems with disturbances. Moreover, without requiring any knowledge of system dynamics, by designing an auxiliary system with a control law and an auxiliary disturbance policy, an online model-free GCC approach is developed by utilizing integral reinforcement learning (IRL) algorithm. To implement the proposed control algorithm, the actor and disturbance NNs are constructed to approximate the optimal control input and worst-case disturbance policy, while the critic NN is utilized to approximate optimal value function. Further, a synchronization weight update law is developed to minimize the NN approximation residual errors. The asymptotic stability of controlled systems is analyzed by applying the Lyapunov’s method. Finally, the effectiveness and feasibility of the proposed control method are verified by two nonlinear simulation examples.

Keywords: Policy iteration; Reinforcement learning; Model-free; Neural network; Completely unknown systems (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0096300321004252
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:apmaco:v:408:y:2021:i:c:s0096300321004252

DOI: 10.1016/j.amc.2021.126336

Access Statistics for this article

Applied Mathematics and Computation is currently edited by Theodore Simos

More articles in Applied Mathematics and Computation from Elsevier
Bibliographic data for series maintained by Catherine Liu ().