Turbocharged: automating quality analysis in trust & safety

Alexandra Bianca Tîrnăcop ()
Additional contact information
Alexandra Bianca Tîrnăcop: Bucharest University of Economic Studies, Bucharest, Romania

CACTUS - The Tourism Journal for Research, Education, Culture and Soul, 2025, vol. 32, issue 1

Abstract: Trust and Safety (T&S) is a key framework for online platforms, aiming to protect users from harm such as misinformation, harassment, and exploitation, while also supporting free expression. Although policies, AI tools, and cross-platform collaboration (e.g., GIFCT, StopNCII.org) enhance moderation, significant challenges remain. This study uses a demo dataset of 15 social media posts, reviewed by 9 moderators and checked by a single analyst. Each ticket has been reviewed by three raters to ensure agreement. The model achieved a precision, recall, and F1 score of 70.37%, with an overall accuracy of 64.44%. Automation improves efficiency but requires bias moderation, transparency, and human intervention to address challenging content. However, outsourcing and underinvestment in moderators raise ethical concerns, as human reviewers face psychological risks without adequate support. To address these issues, this paper proposes a decision matrix for use in both machine learning training and moderator and quality analyst training.

Keywords: artificial intelligence; key performance indicators; machine learning (search for similar items in EconPapers)
JEL-codes: M11 O22 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://cactus-journal-of-tourism.ase.ro/wp-conten ... t12_III-Tirnacop.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bum:cactus:cactus-2025-21

Access Statistics for this article

CACTUS - The Tourism Journal for Research, Education, Culture and Soul is currently edited by CACTUS Editorial Team

More articles in CACTUS - The Tourism Journal for Research, Education, Culture and Soul from Bucharest University of Economic Studies
Bibliographic data for series maintained by CACTUS Editorial Team ().