Effects of trust and perceived self-efficacy on aided judgement: an experiment on spelling and grammar checking

Melle Zijlstra and Stephen J. Payne

Behaviour and Information Technology, 2025, vol. 44, issue 18, 4458-4472

Abstract: We report an experimental study in which participants make a series of linguistic judgements with help from a fictional text-editing aid. The study illuminates how acceptance of a software aid's advice might be affected by, and in turn affects, users’ trust and confidence.We measure the propensity to accept automated advice by adapting Signal Detection Theory (SDT), and particularly the construct of bias. Our study demonstrates a significant difference in bias between groups who interact with aids that perform at different levels of reliability. Participants’ pre-task trust in similar systems also affected bias towards the aid, but we found no evidence for such an effect of prior perceived self-efficacy.Users show an awareness of their own performance, demonstrated by higher self-reported confidence in correct responses than in incorrect ones. Further, participants using a more reliable aid are more confident when accepting than when rejecting the aid's advice. Overall, participants were overconfident in their judgements.Our research demonstrates opportunities of using an experimental paradigm, analysed with SDT, to study aspects of performance, trust, and confidence in knowledge-based cognitive tasks aided by an artificially intelligent aid.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/0144929X.2025.2478277 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tbitxx:v:44:y:2025:i:18:p:4458-4472

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tbit20

DOI: 10.1080/0144929X.2025.2478277

Access Statistics for this article

Behaviour and Information Technology is currently edited by Dr Panos P Markopoulos

More articles in Behaviour and Information Technology from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().