Pipeformer: A multi-channel patching-based transformer method with pyramid cross-attention for leak detection of energy transportation system

Junkai Wang, Tianbiao Wang and Dazhong Ma

Energy, 2025, vol. 335, issue C

Abstract: Accurate leak detection in an energy transportation system can effectively reduce the likelihood of a disaster. To enhance detection accuracy and reduce false alarm rate, a multi-channel patching-based transformer method with pyramid cross-attention for pipeline (Pipeformer) in energy transportation system is proposed. First, a transformer encoder-based representation learning framework is presented to tackle the pipeline leak detection task by utilizing unsupervised clustering algorithms. Then, given the interconnections among pressure data in pipeline, a multi-channel patch embedding strategy is proposed to patch the multivariate time series at unequal time steps to capture pressure variation features at different scales. Specifically, within the same scale, it can adequately capture the differences between local and global features by patching the data, as well as consolidate comprehensive feature information through fusion among different scales. Moreover, a pyramid cross-attention mechanism is designed with the help of the feature pyramid structure that has been constructed through patching. Cross-attention between different layers is used to convey feature information, while relying on this structure to capture both short-term fine-grained patterns and long-term coarse-grained trends. The interaction of information among features at different scales enables the model to effectively learn cross-scale dependencies. Finally, leak detection task of energy transportation system is implemented by a clustering algorithm and a series of comparison and ablation experiments are carried out using the collected data. The detection accuracy and false alarm rates can achieve satisfactory results, which verifies the validity of the method.

Keywords: Pipeline leak detection; Patch embedding; Pyramid cross attention; Clustering algorithms; Representation learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225037387
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:335:y:2025:i:c:s0360544225037387

DOI: 10.1016/j.energy.2025.138096

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().