Fully data-driven and modular building thermal control with physically consistent modeling

Mina Montazeri, Carl Remlinger, Benjamin Bejar Haro and Philipp Heer

Applied Energy, 2025, vol. 390, issue C, No S0306261925005008

Abstract: Machine learning has experienced significant growth in the smart building sector, whether for building modeling or energy management. Data-driven approaches leverage available measurements to bypass the slow and costly calibration of physics-based models, offering adaptability, low maintenance and greater flexibility. However, the quality of these models depends on historical data, which may be lacking for newly constructed buildings. This paper introduces a fully data-driven modular approach, from temperature modeling to heating control, that requires few data when transferred from a source to a target building. The controller consists of two modules: a deep reinforcement learning agent that manages the desired room temperature and an action-mapper specific to each room that adjusts heating controls. To adapt the controller to a new room, only the action-mapper is substituted. This approach requires just a few weeks of data and reuses an effective policy with minimal effort. The controller is trained using a neural network-based environment simulator, incorporating physical consistency to ensure accurate states and rewards. Simulations and real-world tests show the modular controller achieves 13 % average energy savings (up to 17 %) compared to traditional transfer learning methods, and 26 % (up to 32 %) compared to rule-based controllers, without compromising comfort.

Keywords: Building energy management; Building thermal control; Deep reinforcement learning; Transferability; Modular (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261925005008
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:390:y:2025:i:c:s0306261925005008

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2025.125770

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().