Reinforcement learning-based optimised control for a class of second-order nonlinear dynamic systems

Bin Li, Xue Yang, Ranran Zhou and Guoxing Wen

International Journal of Systems Science, 2022, vol. 53, issue 15, 3154-3164

Abstract: This paper presents an optimised tracking control scheme based on reinforcement learning (RL) for a class of second-order nonlinear systems with unknown dynamics. Different from the first-order dynamic system control, the second-order case is required to synchronously steer two variables of position and velocity, hence it makes this optimised control more challenging to accomplish. To achieve the optimised control, first, neural network (NN) is employed to approximate the solution of Hamilton–Jacobi–Bellman (HJB), and then an RL is performed by constructing both critic and actor based on the NN approximation. Since the RL training laws are derived from the negative gradient of a simple positive function generated in accordance with the partial derivative of HJB equation, it can make the control algorithm significantly simple to compare with the existing optimal control methods. Meanwhile, it can also release the condition of persistence excitation and compensate for the nonlinear uncertainty. Finally, the proposed adaptive control method can guarantee the desired results that are demonstrated by theorem, proof and simulation.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2022.2074568 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:53:y:2022:i:15:p:3154-3164

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2022.2074568

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().