HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces

Zetian Huang, Jianping Chen, Qiming Fu, Hongjie Wu, You Lu and Zhen Gao

Mathematical Problems in Engineering, 2020, vol. 2020, 1-12

Abstract:

We propose an optimization method, named as the Multistep-Actor Critic (MAC) algorithm, which uses the value-network and the action-network, where the action-network is based on the deep Q-network (DQN). The proposed method is intended to solve the problem of energy conservation optimization of heating, ventilating, and air-conditioning (HVAC) system in a large action space, principally for the cases with high computation and convergence time. The method employs the multistep action-network and search tree to generate the original state and then selects the optimal state based on the value-network for the original and the adjacent states. The results from the application of the MAC algorithm to a simulation problem on the TRNSYS system, where the simulation problem is referring to a real supertall building in Hong Kong, have shown that the proposed MAC algorithm balances control actions between different HVAC subsystems. Further, it substantially saves the computational time while maintaining a good energy conservation performance.

Date: 2020
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://downloads.hindawi.com/journals/MPE/2020/1386418.pdf (application/pdf)
http://downloads.hindawi.com/journals/MPE/2020/1386418.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnlmpe:1386418

DOI: 10.1155/2020/1386418

Access Statistics for this article

More articles in Mathematical Problems in Engineering from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().