A feature optimized attention transformer with kinetic information capture and weighted robust Z-score for industrial NOx emission forecasting

Jian Long, Siyu Jiang, Luyao Wang, Jiazi Zhai, Feng Zhang and Liang Zhao

Energy, 2025, vol. 326, issue C

Abstract: Establishing an accurate and stable NOx concentration prediction model is of great significance for pollution control in refineries and achieving carbon neutrality goals. The actual industrial denitrification process exhibits high nonlinearity, strong coupling, and multivariable dynamic characteristics, which makes modeling difficult. This paper proposes a novel model based on Transformer designed to uncover the potential dynamic relationships between variables. First, for unstable industrial data, a Weighted Robust Z-score (WRZ) method is employed, which assigns weights to data points and uses weighted median and interquartile range to replace traditional mean and standard deviation for calculating deviations of data points. Second, to address the complex dynamic characteristics of the data, an Enhanced Pooling Feature Module (EPFM) is proposed, combining weighted pooling and average pooling to optimize feature extraction. Embedded in Transformer, EPFM adjusts attention, highlighting key features. Finally, Attention scores visualization explicitly clarifies variable interaction mechanisms, enhancing model interpretability. Experiments on four chemical datasets validated the proposed model's effectiveness. In the catalytic cracking regeneration flue gas denitrification dataset, the proposed method has RMSE values of 0.8 and 0.922, and R2 values of 0.993 and 0.956, outperforming others. It offers an effective way to boost industrial denitrification efficiency and reduce NOx emissions.

Keywords: NOx concentration prediction; Kinetic knowledge; Transformer; Dynamic interactions; Attention mechanism (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225019188
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:326:y:2025:i:c:s0360544225019188

DOI: 10.1016/j.energy.2025.136276

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().