Towards smart control and energy efficiency for multi-zone ventilation systems via an imitation-interaction learning method in energy-aware buildings

Yuntao Liu, Yutong Song and Can Cui

Energy, 2025, vol. 314, issue C

Abstract: In this paper, an imitation-interaction learning (Imit-IR) method is proposed for multi-zone ventilation systems, to enhance the ventilation control performance and optimizes system energy efficiency. This method synergizes online reinforcement learning (RL) with offline imitation learning to expedite the convergence speed of RL and bolster the validity of exploration in the training process. In the imitation learning phase, the RL policy network is pre-trained via behavioral cloning using suboptimal demonstration sampled from expert trajectories. In the interaction learning phase, the control performance of the RL agent is significantly boosted by migrating network parameters from the offline phase and through environmental interaction. The proposed Imit-IR method offers the following advantages: a) The convergence speed of RL online learning is effectively accelerated, leveraging on biased sampling expert demonstration in offline learning. b) The proposed method exhibits good dynamic characteristics under time-varying demands, with the maximum airflow error controlled within 6 %. c) Test results demonstrate that the proposed method can achieve a maximum energy savings of 18.9 % compared to the three benchmark methods. d) The proposed method has good generalization ability under various dynamic scenarios and ventilation system topologies.

Keywords: HVAC; Imitation learning; Reinforcement learning; Ventilation control; Energy efficiency; Optimal control (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224039987
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:314:y:2025:i:c:s0360544224039987

DOI: 10.1016/j.energy.2024.134220

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().