Energy saving evaluation of an energy efficient data center using a model-free reinforcement learning approach

Muhammad Haiqal Bin Mahbod, Chin Boon Chng, Poh Seng Lee and Chee Kong Chui

Applied Energy, 2022, vol. 322, issue C, No S0306261922007309

Abstract: To reduce cooling energy consumption, data centers are recommended to raise temperature setpoints of server intake. However, in tropical climates, Data Center operators are still found to be operating at lower temperatures. In this paper, we demonstrate that using a floating setpoint with a lowered temperature value for tropical climates reduces the overall energy consumption of Data Centers as opposed to raising the temperature in a static manner. We achieve this by applying a deep reinforcement learning algorithm to a hybrid data center model that was built from data collected off a highly efficient data center. This generates an optimal control strategy which minimizes the costs of energy consumption while operating within the required set of operational constraints. Following which, we evaluate the behavior of the control strategy to account for the exact sources of energy savings. The deep reinforcement learning algorithm learns by continually interacting with the built Data Center model without any prior knowledge of the Data Center. The algorithm is trained under the full-load and the part-load configuration of the Data Center. Testing results show that further energy savings of up to 3% and 5.5% (under full load and part load respectively) can be achieved with targeted cooling provisioning while operating within constraints in an already cooling-efficient Data Center. We find that while building level optimization studies of Data Centers generally improve energy efficiency, the source of energy savings is not well accounted for. Consequently, our studies show that the reduction of server fan usage and not the reduction of cooling energy consumption is the main contributor of energy savings in a deep reinforcement learning-driven data center operating in the tropics.

Keywords: Data center; Data center cooling strategies; Cooling control; Deep reinforcement learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261922007309
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:322:y:2022:i:c:s0306261922007309

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2022.119392

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().