Text analytics methods for automatic annotation of scientific documents

Аdilbek Tanirbergenov (), Madi Akhmetzhanov (), Zhazira Taszhurekova (), Munaram Khassanova () and Bolat Tassuov ()

International Journal of Innovative Research and Scientific Studies, 2025, vol. 8, issue 4, 491-499

Abstract: This study aims to develop a hybrid system for the automatic annotation of scientific texts that efficiently processes multilingual publications using state-of-the-art natural language processing (NLP) technologies. The system integrates classical algorithms (Gensim, NLTK) with transformer-based models via the Cohere API to achieve high semantic consistency and accuracy in annotations. The system architecture comprises modules for data acquisition, preprocessing, manual and automatic annotation, data storage, and quality control. The performance of the proposed model was benchmarked against established methods such as BERTSUM, TF-IDF + LSA, and GPT-3.5-turbo using evaluation metrics including ROUGE, BLEU, and METEOR. The hybrid model outperformed other automated systems, demonstrating superior scores across ROUGE-1 (0.52), BLEU (0.41), and METEOR (0.39) metrics, indicating its effectiveness in producing concise and semantically accurate summaries. The system also achieved 100% language detection accuracy and 90% accuracy in semantic word relationships via Word2Vec. The integration of traditional statistical methods with advanced transformer models enables the proposed system to deliver high-quality annotations suitable for diverse scientific domains. The results validate the model’s ability to process and summarize complex scientific texts effectively. This system provides a scalable, secure, and user-friendly platform for researchers, institutions, and developers. It supports multilingual annotation, seamless API integration, and potential deployment in cloud environments, offering significant benefits for academic, biomedical, and information-intensive sectors.

Keywords: Automatic summarization; BLEU; Cohere API; Gensim; Machine learning; METEOR; Multitasking models; NLP; ROUGE; Scientific articles; Text annotation. (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijirss.com/index.php/ijirss/article/view/7876/1722 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aac:ijirss:v:8:y:2025:i:4:p:491-499:id:7876

Access Statistics for this article

International Journal of Innovative Research and Scientific Studies is currently edited by Natalie Jean

More articles in International Journal of Innovative Research and Scientific Studies from Innovative Research Publishing
Bibliographic data for series maintained by Natalie Jean ().