Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems

Shuwen Zheng, Kai Pan, Jie Liu and Yunxia Chen

Reliability Engineering and System Safety, 2024, vol. 252, issue C

Abstract: With increasing complexity and interconnectivity of the modern industrial systems, effectively diagnosing faults is a core step to Prognostic and Health Management (PHM). Language models, particularly Large Language Models (LLMs) that pre-trained on massive corpora, have demonstrated remarkable capabilities in Natural Language Processing (NLP) and its related downstream tasks. However, how to leverage these models for facilitating system fault diagnosis and verify its effectiveness is rarely explored. This paper incorporates the potential comprehension ability of pre-trained LLMs, and investigates the efficacy of fine-tuning LLMs for realizing efficient system fault diagnosis. The experiments conducted in this study involve both open-source and closed-source models, and utilize a simulation and a real fault diagnosis dataset. We find that these models consistently achieve high performance across various metrics compared to the baselines. Additionally, qualitative and quantitative analysis is performed to investigate several aspects of the approach, such as the impact of dataset size, data normalization, missing values and explainability of the diagnosis, further showcasing the potential as well as limitations of the approach.

Keywords: prognosis and health management; fault diagnosis; large language model; complex systems; high-speed train; chemical plant (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S095183202400454X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:252:y:2024:i:c:s095183202400454x

DOI: 10.1016/j.ress.2024.110382

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().