How to test AI: A case study of a machine learning-based trading system

Olga Lewandowska and Edgar Mai
Additional contact information
Olga Lewandowska: Mainstay, Germany
Edgar Mai: Chief Executive Officer, Mainstay, Germany

Journal of Securities Operations & Custody, 2024, vol. 17, issue 1, 26-42

Abstract: The rapid evolution of artificial intelligence (AI) and especially machine learning (ML) has significantly transformed the technological landscape, influencing diverse sectors and making notable inroads into the realm of finance. This paper delves into the challenges posed by ML models, known for their black-box nature, non-deterministic behaviour, reliance on big data and inherent complexity, often lacking clear specifications. These characteristics present novel testing challenges compared to traditional software. In addressing these challenges, the authors introduce a conceptual framework tailored for testing ML-based systems, with a specific focus on financial applications. Theoretical concepts are exemplified through a real-world case study of the implementation of an ML-based bond trading system within a banking context. As the AI technologies become increasingly integrated into critical financial systems, a deeper understanding of their testing strategies will be essential for mitigating risks and harnessing their full potential. The heightened significance of in-depth testing knowledge, propelled by AI-driven progress, holds relevance for both testers and managers in navigating the complexities of the technological changes.

Keywords: artificial intelligence (AI); machine learning (ML); digital banking; innovation; testing; software testing; software quality; test automation (search for similar items in EconPapers)
JEL-codes: E5 G2 K22 (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://hstalks.com/article/8812/download/ (application/pdf)
https://hstalks.com/article/8812/ (text/html)
Requires a paid subscription for full access.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aza:jsoc00:y:2024:v:17:i:1:p:26-42

Access Statistics for this article

More articles in Journal of Securities Operations & Custody from Henry Stewart Publications
Bibliographic data for series maintained by Henry Stewart Talks ().