Deep reinforcement learning-based stability control for biomass thermal-electric conversion system: Experimental analysis and multi-physics coupled modeling

Hang Li, Xinhui Liu, Bingwei Cao, Jianwen Yang, Changyi Liu and Wei Chen

Energy, 2025, vol. 336, issue C

Abstract: Remote mountainous regions and temporary installations face dual energy challenges: grid infrastructure deficiencies cause unstable power supply, further exacerbated by the inherent limitations of conventional biomass power systems in dynamic control of energy conversion processes. This study experimentally investigated the impact of airflow on the performance of the biomass thermal-electric conversion system (BTECS) and developed an intelligent control framework using deep reinforcement learning for BTECS. The framework established multi-physics-coupled differential equations for gasification-heat transfer-power generation processes. Comparative evaluation was performed for four algorithms: Double Deep Q-Network (DDQN), Proximal Policy Optimization (PPO), Soft Actor-Critic (SAC), and Asynchronous Advantage Actor-Critic (A3C). Key findings revealed that an optimal airflow rate of 9.2 m3/h reduced the target power achievement time to 630 s (a 79 % reduction from 2980 s at 6.5 m3/h). Moreover, a physically interpretable simulation model was established via Newton's law of cooling, polynomial fitting, and multiple regression based on experimental data. The DDQN algorithm demonstrated superior performance compared to other algorithms and conventional controllers, achieving 98.32 % of the target power output (786.56 ± 30.85 W), with 2.4 times faster convergence and 65.5 % lower computational cost than SAC. This study demonstrates the technical superiority of deep reinforcement learning in optimizing the BTECS while offering implementable energy solutions for off-grid applications.

Keywords: Deep reinforcement learning; Multi-physics coupling; Stability control; Electrical energy generation (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225040423
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:336:y:2025:i:c:s0360544225040423

DOI: 10.1016/j.energy.2025.138400

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().