Cutting-edge Technologies for Analyzing Student Feedback to Inform Institutional Decision-making in Higher Education

Sabur Butt (), Sandra Dennis Núñez Daruich (), Joanna Alvarado-Uribe () and Hector G. Ceballos ()
Additional contact information
Sabur Butt: Tecnológico de Monterrey
Sandra Dennis Núñez Daruich: Tecnológico de Monterrey
Joanna Alvarado-Uribe: Tecnológico de Monterrey
Hector G. Ceballos: Tecnológico de Monterrey

Foresight and STI Governance, 2025, vol. 19, issue 4, 68-80

Abstract: Aspect-Based Sentiment Analysis (ABSA) has emerged as a powerful tool for deriving actionable insights from qualitative feedback in education. This study presents a multitask learning framework to analyze student evaluations of teaching (SET) by extracting and classifying opinions on specific aspects of teaching performance. Leveraging a novel and first open-sourced dataset of 6,025 Spanish-language comments, the proposed framework integrates opinion segmentation and multi-label classification to capture nuanced feedback on nine predefined aspects, such as "Teaching Quality" and "Classroom Atmosphere." Applications of this approach extend beyond SET analysis, offering valuable insights for course improvement, faculty assessment, and institutional decision-making in higher education. The paper compares the performance of fine-tuned transformers (BERT and RoBERTa) with large language models (LLMs), including GPT-4o, GPT4o-mini, and LLama-3.1-8B, using both fine-tuned and Few-shot Chain of Thought (CoT) methodologies. Evaluation results reveal that fine-tuned GPT-4o outperformed all other models, achieving a weighted F1-score of 0.69 for positive aspects and 0.79 for negative aspects, while Few-shot CoT approaches demonstrated competitive performance with greater scalability and interpretability. Our findings demonstrate the framework's potential to transform unstructured feedback into structured insights, aiding educators and institutions in enhancing teaching quality and student engagement.

Keywords: aspect-based sentiment analysis (ABSA); student evaluations of teaching (SET); opinion segmentation; multi-label classification; large language models (LLMs); few-shot chain of thought (CoT). (search for similar items in EconPapers)
JEL-codes: I21 O33 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://foresight-journal.hse.ru/article/view/28047
https://foresight-journal.hse.ru/article/view/28047/22873 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hig:fsight:v:19:y:2025:i:4:p:68-80

Access Statistics for this article

More articles in Foresight and STI Governance from National Research University Higher School of Economics
Bibliographic data for series maintained by Nataliya Gavrilicheva () and Mikhail Salazkin ().