Scaling Product Acceptance Analysis Using Annotation Systems Based on Large Language Models

Joseph Januszewicz (), Pawel Robert Smolinski () and Jacek Winiarski ()
Additional contact information
Joseph Januszewicz: Geisel School of Medicine at Dartmouth
Pawel Robert Smolinski: University of Gdansk
Jacek Winiarski: University of Gdansk/Faculty of Economics

A chapter in Advances in Information Systems Development, 2025, pp 1-21 from Springer

Abstract: Abstract While Technology Acceptance Models (TAM) are widely used, their practical utility remains in question. Significant challenges to the useful application of TAM include the difficulties in gathering TAM data through traditional methods of surveys and questionnaires and the homogeneity hypothesis for technology predictors, which constrains the usefulness of TAM models in comparing products. This paper addresses both challenges by (1) validating the use of NLP-LLM to incorporate unstructured online data into TAM models rather than surveys and (2) demonstrating and validating a TAM model without homogenous predictors by applying it to the handheld gaming console market. We use Amazon reviews for Nintendo, Steam Deck, Logitech, and Razer consoles, annotating them using Chat GPT NLP-LLM-algorithms to obtain scores for TAM variables. We validate the use of NLP-LLMs by measuring high consistency between LLM runs and strong agreement with scores given by human experts. We then fit separate TAM regressions for each console and compare coefficients, revealing significant heterogeneity with the Steam Deck emerging as a market leader and Nintendo lagging behind its competitors. Altogether, we demonstrate that TAM models with heterogeneous predictors are both useful and applicable, and that NLP-LLM powered models have the ability to provide results highly similar to current more expensive and limited methods.

Keywords: Technology acceptance model; Product comparison; Comparative analysis; Handheld gaming consoles (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:lnichp:978-3-031-87880-0_1

Ordering information: This item can be ordered from
http://www.springer.com/9783031878800

DOI: 10.1007/978-3-031-87880-0_1

Access Statistics for this chapter

More chapters in Lecture Notes in Information Systems and Organization from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().