ML Models Deployed: What Is Next?

Helmut Degen ()
Additional contact information
Helmut Degen: Siemens Technology

A chapter in The Design of Human-Centered Artificial Intelligence for the Workplace, 2025, pp 219-244 from Springer

Abstract: Abstract Machine learning (ML) models augment many software applications across consumer, industrial, and military domains. It is known that the performance of ML models degrade over time. Model degradation can lead to incorrect predictions with potentially risky or harmful consequences. The state-of-the-art approach for model degradation is the use of model monitoring applications that detect and report model anomalies, based on model metrics, such as feature importance or F1 scores. Such metrics and the reported anomalies are comprehensible for data scientists, but not so much for users without a data science background from the application domain (e.g., medical, manufacturing, finance). Since model metrics are disconnected from the application domain context, it can take up to several days for a data scientist to identify the root cause of an anomaly and how to resolve it. This chapter presents an interaction concept for model monitoring that was validated by end users. It will provide answer to the following questions: Q1: How to enable application domain experts (with limited or no AI background) to understand a reported model anomaly and its root cause so they can select and initiate a response action in a timely manner? Q2: How to enable application domain experts to validate that a selected and initiated responsive action was effective? Q3: What are the cross-validation results of the interaction concept with selected user involvement models (Endsley 1995; Endsley and Kaber 1999; Rasmussen 1974)?

Date: 2025
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prochp:978-3-031-83512-4_13

Ordering information: This item can be ordered from
http://www.springer.com/9783031835124

DOI: 10.1007/978-3-031-83512-4_13

Access Statistics for this chapter

More chapters in Progress in IS from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().