Infinite-time robust optimal output tracking of continuous-time linear systems using undiscounted reinforcement learning

Ali Amirparast and S. Kamal Hosseini Sani

International Journal of Systems Science, 2024, vol. 55, issue 14, 2933-2951

Abstract: This research paper focuses on addressing the challenge of infinite-time linear quadratic tracking control (LQT) for linear systems with parametric uncertainty. Traditional solutions to the LQT problem often involve using a discount factor to prevent the cost function from growing unbounded over time. However, this approach can introduce instability in the closed-loop system. To overcome this issue, this paper proposes an alternative approach using an undiscounted cost function that ensures the asymptotic stability of the uncertain closed-loop system. To design a control scheme without requiring precise knowledge of the system dynamics, reinforcement learning (RL) algorithms are employed. However, for systems with uncertain parameters that may lead to instability, the convergence of RL algorithms to a stabilising solution is not guaranteed. To address this limitation, a robust optimal control structure is developed using on-policy and off-policy reinforcement learning algorithms, resulting in a model-free controller. The effectiveness of the proposed robust optimal controller is validated through comparative simulations on an uncertain model of a DC–DC buck converter connected to a constant power load. These simulations demonstrate the advantages and benefits of the robust optimal controller in handling parametric uncertainty and ensuring stability in the control system.

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2024.2364289 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:55:y:2024:i:14:p:2933-2951

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2024.2364289

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().