Investigation into the Performance Enhancement and Configuration Paradigm of Partially Integrated RL-MPC System

Wanqi Guo () and Shigeyuki Tateno
Additional contact information
Wanqi Guo: Graduate School of Information, Production and Systems, Waseda University, Kitakyushu 8080135, Fukuoka, Japan
Shigeyuki Tateno: Graduate School of Information, Production and Systems, Waseda University, Kitakyushu 8080135, Fukuoka, Japan

Mathematics, 2025, vol. 13, issue 15, 1-33

Abstract: The improvement of the partially integrated reinforcement learning-model predictive control (RL-MPC) system is developed in the paper by introducing the Deep Deterministic Policy Gradient (DDPG) and Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithms. This framework differs from the traditional ones, which completely substitute the MPC prediction model; instead, an RL agent refines predictions through feedback correction and thus maintains interpretability while improving robustness. Most importantly, the study details two configuration paradigms: decoupled (offline policy application) and coupled (online policy update) and tests them for their effectiveness in trajectory tracking tasks within simulation and real-life experiments. A decoupled framework based on TD3 showed significant improvements in control performance compared to the rest of the implemented paradigms, especially concerning Integral of Time-weighted Absolute Error (ITAE) and mean absolute error (MAE). This work also illustrated the advantages of partial integration in balancing adaptability and stability, thus making it suitable for real-time applications in robotics.

Keywords: model predictive control; twin delayed deep deterministic policy gradient; partial integration; configuration paradigm (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/15/2341/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/15/2341/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:15:p:2341-:d:1707577

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().