An Example of the Consistency Analysis of the Classification of Textual Materials by the Analyst and using the Naïve Bayesian Classifier

Josip Jezovita (), Mateja Plenkovic and Nika Djuho
Additional contact information
Josip Jezovita: Catholic University of Croatia, Zagreb, Croatia
Mateja Plenkovic: Catholic University of Croatia, Zagreb, Croatia
Nika Djuho: Catholic University of Croatia, Zagreb, Croatia

Interdisciplinary Description of Complex Systems - scientific journal, 2023, vol. 21, issue 6, 607-622

Abstract: Sentiment analysis is a particular form of content analysis, and its application has become popular with the growth of Internet platforms where a wide range of content is generated. Today, various classifiers use for sentiment analysis, and in this article, we show an example of using a Naïve Bayesian classifier. The aim is to examine the consistency of classifying textual materials into a positive, negative or neutral tone by analysts and the Bayesian algorithm. The hypotheses are that there is an increase in the agreement between the two ways of classifying textual materials as (1) the complexity of the formulations and (2) the size of the learning datasets increases. Based on the results, both hypotheses were accepted, but only on certain groups of messages. Increasing the size of the learning datasets and increasing the complexity of the formulations helped the classification accuracy for messages in a positive tone, while the classification accuracy for messages in other tones was high and equal regardless of varying the parameters. Correlation analysis showed a high positive correlation between the outcomes the Bayesian algorithm classified and the tones the analyst determined (r = 0,816).

Keywords: content analysis; sentiment analysis; naïve Bayes classifier (search for similar items in EconPapers)
JEL-codes: C38 (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.indecs.eu/2023/indecs2023-pp607-622.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zna:indecs:v:21:y:2023:i:6:p:607-622

Access Statistics for this article

More articles in Interdisciplinary Description of Complex Systems - scientific journal from Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu
Bibliographic data for series maintained by Josip Stepanic ().