Machine learning-based outlier detection for pipeline in-line inspection data

Muhammad Hussain and Tieling Zhang

Reliability Engineering and System Safety, 2025, vol. 254, issue PA

Abstract: Pipeline companies are facing challenges in maintaining the integrity and reliability of their pipelines. They are working towards predictive maintenance using machine learning-based approaches to predicting anomalies. Training machine learning models requires sufficient data. Data quality is therefore becoming important because inaccurate data will lead to an inaccurate or wrong decision on pipeline condition assessment and the following management. This research paper intends to address the data quality issues of pipeline inspection data such as in-line inspection (ILI) data using machine learning models. Different machine learning models developed by random forest regression, linear regression, and nearest neighbors’ methods were tested to detect outliers in the ILI data. In this paper, the ILI data collected from an oil pipeline over a period of 22 years was applied to testing and analysis. To verify the outlier detection results of machine learning models, we used statistical analysis including Z-score method to check and find if there are any gaps in the analysis. It verifies that all these methods show almost the same or very similar results for the detection of the outliers. Hence, this study presents a robust method for the field applications in the pipeline industry.

Keywords: Data quality; Outlier detection; Machine learning; In-line inspection (ILI); Statistical analysis (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832024006252
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006252

DOI: 10.1016/j.ress.2024.110553

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().