Explainability in process outcome prediction: Guidelines to obtain interpretable and faithful models

Alexander Stevens and Johannes De Smedt

European Journal of Operational Research, 2024, vol. 317, issue 2, 317-329

Abstract: Process outcome prediction pertains to the classification of ongoing cases of (business) processes into a given set of categorical outcomes. This field of research has seen a strong uptake in recent years due to advances in machine and deep learning. Although a recent shift has been made in the field of process outcome prediction to use models from the explainable artificial intelligence field, the evaluation still occurs mainly through predictive performance-based metrics, thus not accounting for the explainability, actionability, and the implications of the results of the models. This paper addresses explainability through the properties interpretability and faithfulness in the field of process outcome prediction. We introduce metrics to analyse these properties along the main dimensions of process data: the event, case, and control flow attributes. This allows for comparing explanations produced by transparent models with explanations generated by (post-hoc) explainability techniques on top of opaque black box models. We utilise thirteen real-life event logs and seven classifiers, encompassing a variety of transparent and non-transparent machine learning and deep learning models, complemented with (post-hoc) explainability techniques. Next, this paper contributes a set of guidelines named X-MOP for obtaining explainable models for outcome prediction, which helps to select the most suitable model by providing insight into how the varying preprocessing, model complexity, and explainability techniques typical in process outcome prediction influence the explainability of the model.

Keywords: Data science; Explainable artificial intelligence; Process outcome prediction; Interpretability; Faithfulness (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221723007117
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:317:y:2024:i:2:p:317-329

DOI: 10.1016/j.ejor.2023.09.010

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().