Algorithmic self-referentiality: How machine learning pushes calculative practices to assess themselves

Yuval Millo, Crawford Spence and Ruowen Xu

Accounting, Organizations and Society, 2024, vol. 113, issue C

Abstract: Despite the growing importance of machine learning in today's organisations, we know relatively little about how machine learning operates and how it influences calculative practices and cultures. Based on 695 hours of ethnographic fieldwork in the team of credit modellers from a large internet company in China, this study analyses the calculative culture that underpins the development of credit models. We show that credit scoring methodologies develop progressively into a self-referential set of calculative practices where substantive concerns about loan default are supplanted by more insular concerns around the seamless operation of the model. Insofar as the latter can only be measured by the model itself, this reduces the role of calculative experts to facilitators of machine learning rather than the purposeful interpreters of machine learning produced data. In this regard, credit scoring experts focus more on ensuring that models have a robust conversation with themselves rather than with managers or credit scoring agents. This matters because machine learning-driven credit scoring models end up privileging access to credit for those whose data trails more readily pass through data preparation filters rather than those who are less likely to default. We thus contribute to an understanding of how machine learning-driven calculative cultures both enact algorithmic bias and operate beyond the ken of purposeful human actors.

Keywords: Credit scoring; Calculative culture; Calculative practices; Machine learning; Algorithmic bias (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0361368224000278
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:aosoci:v:113:y:2024:i:c:s0361368224000278

DOI: 10.1016/j.aos.2024.101567

Access Statistics for this article

Accounting, Organizations and Society is currently edited by Christopher Chapman

More articles in Accounting, Organizations and Society from Elsevier
Bibliographic data for series maintained by Catherine Liu ().