A demand response strategy for direct expansion air conditioning systems combining self-modeling and reinforcement learning

Ying Chen, Junqiang Shao and Xiangguo Xu

Energy, 2025, vol. 332, issue C

Abstract: This study addresses the challenges faced by existing research in direct-expansion (DX) air conditioning demand response control, particularly high modeling costs and privacy concerns. A novel demand response control strategy is proposed, which integrates low-cost modeling with RL techniques. The self-learning algorithm leverages sensors, controllers, and IoT-based weather data to quickly learn the dynamic thermal and humidity characteristics of a room, based on a 2-h indoor temperature and humidity change. This self-learning model is subsequently used to design an intelligent control strategy for the DX air conditioning system, derived through cloud-based RL. A case study validates the effectiveness of the approach, demonstrating that the demand response control strategy, trained using Proximal Policy Optimization (PPO) with the self-learning dynamic thermal and humidity model, outperforms both single temperature control and energy-saving strategies. The results show significant reductions in energy consumption and electricity costs while improving responsiveness to time-of-use electricity pricing.

Keywords: Demand response; Reinforcement learning; Fast self-learning; Dynamic thermal and humidity control (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S036054422502938X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:332:y:2025:i:c:s036054422502938x

DOI: 10.1016/j.energy.2025.137296

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().