A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting

Yun Wang, Houhua Xu, Mengmeng Song, Fan Zhang, Yifen Li, Shengchao Zhou and Lingjun Zhang

Applied Energy, 2023, vol. 333, issue C, No S030626192201858X

Abstract: Wind speed forecasting plays an important role in the stable operation of wind energy power systems. However, accurate and reliable wind speed forecasting faces four challenges: how to reduce the data noise; how to find the optimal model inputs; how to describe the complex fluctuations in wind speed; and how to design a suitable loss function to tune the forecasting model. This study proposes a novel forecasting model to address the four challenges mentioned above. First, it uses a wavelet soft threshold denoising method to reduce noise in the original wind speed time series. Second, it uses the maximal information coefficient, which measures the linear and nonlinear relationships between historical wind speed data and forecasted targets, to determine the optimal model inputs. Third, a novel convolutional Transformer-based truncated Gaussian density network is designed to characterize the complex fluctuations in wind speed. The multi-scale information from different convolutional layers is weighted using the self-attention mechanism and then fed into the Transformer network to extract temporal information. The outputs are mapped into the forecasted targets with several fully connected layers. Fourth, considering the non-negativity of wind speed, the truncated Gaussian distribution, which shows a probability of zero when the wind speed is less than zero, is employed to model the uncertainty of wind speed forecasts. This leads to designing a truncated Gaussian distribution-based loss function to train the forecasting model. The forecasting results on three real-world datasets show that the proposed model not only provides accurate deterministic wind speed forecasts but also produces reliable probabilistic wind speed forecasts. The hypothesis testing also illustrates the effectiveness of the proposed model for deterministic and probabilistic wind speed forecasting.

Keywords: Wind speed forecasting; Multi-scale features; Truncated Gaussian-based loss function; Transformer; Wavelet soft threshold denoising; Self-attention (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (25)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S030626192201858X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:333:y:2023:i:c:s030626192201858x

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2022.120601

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().