Energy and comfort aware operation of multi-zone HVAC system through preference-inspired deep reinforcement learning

Can Cui and Jing Xue

Energy, 2024, vol. 292, issue C

Abstract: This paper proposes a novel optimal control method for multi-zone HVAC systems to enhance energy efficiency and improve occupant comfort. To address the disturbances in outdoor weather and indoor loads, the proposed method formulates the HVAC control problem as a dynamic Markov decision process, and employs deep reinforcement learning (DRL) techniques to obtain the optimal control policy. To manage multiple goals among thermal comfort, indoor air quality (IAQ) and system energy efficiency, a preference-inspired (P-ins) mechanism is designed to achieve the optimal balance among different objectives. The P-ins mechanism effectively guides the agent towards the optimal control policy with high convergence rate. The proposed method has been validated through EnergyPlus-Python co-simulation testbed with real-world data traces, and assessed by an overall evaluation indicator. Results demonstrate that the proposed method can reduce energy consumption without compromising thermal comfort and IAQ. Specifically, the occurrence of temperature violations is reduced below 0.8 %, and a maximum energy saving of 9.41 % can be achieved, compared with traditional methods.

Keywords: Multi-zone HVAC systems; Preference-inspired mechanism; Multi-objective optimization; Energy saving; Thermal comfort; Deep reinforcement learning (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224002767
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:292:y:2024:i:c:s0360544224002767

DOI: 10.1016/j.energy.2024.130505

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().