Adaptive optimal coordination control of perturbed Bilateral Teleoperators with variable time delays using Actor–Critic Reinforcement Learning algorithm

Phuong Nam Dao, Quang Phat Nguyen and Manh Hung Vu

Mathematics and Computers in Simulation (MATCOM), 2025, vol. 229, issue C, 151-175

Abstract: In this article, we study the unification of coordination control problem between two sides and optimal control effectiveness for an unknown Bilateral Teleoperators (BTs) under variable time delays in communication between two sides and external disturbance. We proposed the control frame of Actor/Critic strategy and the Robust Integral of the Sign of the Error (RISE), in which the synchronization effectiveness is discussed in two sections with different conditions. The sliding variable is given to transform a BT dynamic model into order reduction model, which can be designed more favourable. By fully analysing optimization problem in designing the training weights of Actor/Critic structure based on the property of Hamiltonian term, Reinforcement Learning (RL) control scheme in each side is proposed for a BT system. Consequently, we incorporate the RISE term into proposed control frame to mathematically prove that the tracking errors asymptotically converge to zero. Furthermore, the proposed control strategy can also guarantee the convergence of learning process. Simulation results and the comparisons demonstrate the performance of the proposed control framework.

Keywords: Reinforcement Learning; Approximate/adaptive dynamic programming (ADP); Actor/Critic structure; Robust Integral of the Sign of the Error (RISE); Bilateral Teleoperators (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378475424003628
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:229:y:2025:i:c:p:151-175

DOI: 10.1016/j.matcom.2024.09.007

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().