A novel encoding method for high-dimensional categorical data for electricity demand forecasting in distributed energy systems

HyoJae Lee, Keisuke Kameda, Sergei Manzhos and Manabu Ihara

Applied Energy, 2025, vol. 392, issue C, No S0306261925007196

Abstract: There has been a gradual shift towards distributed energy systems (DES) with variable renewable energy as the main power source. However, DES present difficulties of controlling the supply-demand balance due to frequent fluctuations in electricity demand caused by human activities in a small-scale system. While energy big data can drive accurate forecasting, it is challenging in the general case due to the increasing cost of the sensor installation and decreasing density of the data in a high-dimensional feature space. To address these problems, we have studied an accurate electricity demand forecasting method without additional sensor installation cost by proposing an encoding process named “Group Encoding” (GE). The GE process was applied to existing high-dimensional binary data of On/Off state, which is already collected in building energy management systems (BEMS). GE can also solve the problem of decreasing data density in a high-dimensional feature space by reducing the dimension without loss of critical information. The effectiveness of GE was evaluated by dealing with high time-resolution data which can be used for various forecast horizons. The forecasting performance improved by 74 % in terms of MAE when using GE, compared to a typical label encoding, for a 1-min ahead forecast. The top-level of electricity forecast accuracy, 3.27 % MAPE (mean absolute percentage error) in 60-min ahead forecasting, compared to the other forecasts for single building was achieved by using only GE processed data and electricity demand.

Keywords: Electricity load forecasting; Encoding; High-dimensional data; Categorical feature; Distributed energy system (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261925007196
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:392:y:2025:i:c:s0306261925007196

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2025.125989

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().