From Analytic Assistant to Scientific Replicator: Testing the Process Fidelity of Generative AI in Qualitative Tourism Research

Rosanna Leung ()
Additional contact information
Rosanna Leung: National Kaohsiung University of Hospitality and Tourism

Chapter 5 in Information and Communication Technologies in Tourism 2026, 2026, pp 59-72 from Springer

Abstract: Abstract This study assesses the capacity of Generative AI to comprehend and implement systematic methodologies for research replication, addressing the crucial need for reliable knowledge transfer in the hospitality and tourism sector. We assessed GAI’s fidelity in replicating the qualitative content analysis of Loo and Leung (2018), which categorized consumer reviews using the 7P marketing mix framework. To rigorously test GAI’s adherence to the scientific process, this study employed a structured Chain-of-Thought (CoT) prompting protocol derived from the original paper’s coding scheme. The comparative performance assessment revealed that while GAI achieved only a low-to-moderate rank correlation with the original output (low output fidelity), it failed to execute the prescribed CoT protocol (high process failure), defaulting instead to an opaque, internal approach. This study’s core contribution is the empirical demonstration that GAI’s inherent “black box” logic compromises the required methodological transparency, thereby fundamentally undermining the knowledge transformation phase of research. GAI is currently an effective analytical assistant but not a trustworthy scientific replicator, posing a significant, fidelity-based barrier to its adoption for high-stakes academic research.

Keywords: Generative AI; Chain-of-Thought; Knowledge transfer; Reproducibility; Hospitality IT; 7Ps marketing mix (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prbchp:978-3-032-23925-9_5

Ordering information: This item can be ordered from
http://www.springer.com/9783032239259

DOI: 10.1007/978-3-032-23925-9_5

Access Statistics for this chapter

More chapters in Springer Proceedings in Business and Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().