Forecasting Energy Consumption of a Public Building Using Transformer and Support Vector Regression

Junhui Huang and Sakdirat Kaewunruen ()
Additional contact information
Junhui Huang: Department of Civil Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK
Sakdirat Kaewunruen: Department of Civil Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK

Energies, 2023, vol. 16, issue 2, 1-15

Abstract: Most of the Artificial Intelligence (AI) models currently used in energy forecasting are traditional and deterministic. Recently, a novel deep learning paradigm, called ‘transformer’, has been developed, which adopts the mechanism of self-attention. Transformers are designed to better process and predict sequential data sets (i.e., historical time records) as well as to track any relationship in the sequential data. So far, a few transformer-based applications have been established, but no industry-scale application exists to build energy forecasts. Accordingly, this study is the world’s first to establish a transformer-based model to estimate the energy consumption of a real-scale university library and benchmark with a baseline model (Support Vector Regression) SVR. With a large dataset from 1 September 2017 to 13 November 2021 with 30 min granularity, the results using four historical electricity readings to estimate one future reading demonstrate that the SVR (an R 2 of 0.92) presents superior performance than the transformer-based model (an R 2 of 0.82). Across the sensitivity analysis, the SVR model is more sensitive to the input close to the output. These findings provide new insights into the research area of energy forecasting in either a specific building or a building cluster in a city. The influences of the number of inputs and outputs related to the transformer-based model will be investigated in the future.

Keywords: CO 2 emissions; energy consumption; transformer; machine learning; building energy performance; building physics; net zero energy building; artificial intelligence (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/1996-1073/16/2/966/pdf (application/pdf)
https://www.mdpi.com/1996-1073/16/2/966/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:16:y:2023:i:2:p:966-:d:1036404

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().