Adaptive NN–RL control for stochastic nonlinear systems with input and full state constraints

Hongyao Li and Fuli Wang

International Journal of Systems Science, 2025, vol. 56, issue 16, 3922-3937

Abstract: This paper investigates the tracking control problem of adaptive neural network (NN) reinforcement learning (RL) for the stochastic nonlinear systems with input and full state constraints. The proposed scheme combines a critic-action RL strategy with bounded control technology, ensuring that both the final controller and all states remain within the time-varying boundaries. In order to estimate the unmeasurable states, a state observer is constructed. Then, an adaptive NN-RL controller is designed. Different from the existing results, the proposed scheme consists of a basic controller and a compensation controller. For the basic controller, the NN approximation technique and the backstepping design method are adopted to address the tracking control problem. By utilising the error variables defined in the basic controller, the compensation controller is constructed based on critic-actor RL algorithm, which optimises the tracking performance while ensuring that the final controller adherence to the time-varying constraints. Due to the projection operator is introduced to design critic-action NN, the issue of gradient explosion encountered in gradient descent methods is averted. Finally, the stability of the closed-loop system is demonstrated via the tangent type time-varying barrier Lyapunov functions (BLFs). The simulation results verify the effectiveness of the proposed scheme.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2025.2480184 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:56:y:2025:i:16:p:3922-3937

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2025.2480184

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().