Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level

Xi Fang, Guangcai Gong, Guannan Li, Liang Chun, Pei Peng, Wenqiang Li and Xing Shi

Energy, 2023, vol. 263, issue PB

Abstract: Model free based DRL control strategies have achieved positive effects on the HVAC system optimal control. However, developing deep reinforcement learning (DRL) control strategies for different building HVAC systems is time-consuming and laborious. To address this issue, this study proposes a transfer learning and deep reinforcement learning (TL-DRL) integrated framework to achieve the DRL control strategy transfer in the building HVAC system level. Deep Q-learning (DQN) is first pre-trained in the source building until it converges to an optimal strategy. Then, the well pre-trained DQN parameters of the first few layers are transferred to the target DQN. Finally, the target DQN parameters of the last few layers are fine-tuned in the target building. An EnergyPlus-Python co-simulation testbed is developed to investigate the cross temporal-spatial transferability of DQN control strategy in the building HVAC system level. Results indicate that the proposed TL-DRL framework can effectively improve the training efficiency of control strategy by about 13.28% when transferring the first two layers compared to that of the DRL baseline models trained from scratch, while simultaneously maintaining energy consumption and indoor air temperature in an acceptable range. The proposed TL-DRL framework provides a preliminary direction for the scalability of intelligent HVAC control strategies.

Keywords: Deep reinforcement learning; Transfer learning; HVAC system Control; Transferability; Training efficiency; Building HVAC system Level (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544222025658
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:263:y:2023:i:pb:s0360544222025658

DOI: 10.1016/j.energy.2022.125679

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().