Exploring the Efficacy and Bias of Sentiment Analysis Tools in Customer Reviews

Mara Dumitru Alexandru (), Culda Lia Cornelia, Cristescu Marian Pompiliu, Nerişanu Raluca Andreea and Moldovan Radu-Anton
Additional contact information
Mara Dumitru Alexandru: Lucian Blaga University of Sibiu, Romania
Culda Lia Cornelia: Lucian Blaga University of Sibiu, Romania
Cristescu Marian Pompiliu: Lucian Blaga University of Sibiu, Romania
Nerişanu Raluca Andreea: Lucian Blaga University of Sibiu, Romania
Moldovan Radu-Anton: Lucian Blaga University of Sibiu, Romania

Journal of Social and Economic Statistics, 2025, vol. 14, issue 1, 19-40

Abstract: Sentiment analysis is an important technique for understanding public sentiment in customer feedback. This study aims to compare the effectiveness and reliability of BERT and VADER in analysing customer reviews from an e-commerce platform. We analyzed mean sentiment scores and standard deviations for each tool, using Spearman’s Rho to assess correlations between VADER and BERT results due to non-normal score distributions. Our findings reveal that VADER predominantly categorizes reviews as Neutral, with limited Positive and Negative classifications, while BERT shows a bias towards Negative sentiments with some Positive and no Neutral classifications. A weak positive correlation indicates limited agreement between the two tools. Additionally, neither tool showed a strong correlation with actual review ratings, highlighting challenges in accurately capturing nuanced sentiments. The study discusses potential biases inherent in each tool’s methodology – VADER’s lexicon-based approach may oversimplify sentiments, and BERT’s deep learning architecture may introduce a negative bias. These findings suggest that combining VADER’s efficiency with BERT’s contextual sensitivity – for instance, through hybrid models – can mitigate individual tool limitations and offer a more robust sentiment analysis framework for e-commerce businesses. By integrating these insights, businesses can optimize customer feedback systems, refine marketing strategies, and improve product development processes

Keywords: customer relationship management; sentiment analysis; BERT; VADER; bias (search for similar items in EconPapers)
JEL-codes: C63 (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/jses-2025-0002 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:jsesro:v:14:y:2025:i:1:p:19-40:n:1002

DOI: 10.2478/jses-2025-0002

Access Statistics for this article

Journal of Social and Economic Statistics is currently edited by Erika Marin

More articles in Journal of Social and Economic Statistics from Sciendo
Bibliographic data for series maintained by Peter Golla ().