Leveraging LLMs for Unstructured Direct Elicitation of Decision Rules

Songting Dong ()
Additional contact information
Songting Dong: UNSW Business School, the University of New South Wales

Customer Needs and Solutions, 2024, vol. 11, issue 1, No 10, 10 pages

Abstract: Abstract Unstructured Direct Elicitation (UDE) offers a flexible method to capture consumer preferences and decision rules in an unstructured format such as writing an email. However, it relies on subjective human coding and indicative consideration set sizes to make accurate predictions on consideration decisions. This research leverages large language models (LLMs) to replace human judges and make predictions without the need for additional information like indicative consideration set sizes. Empirical analyses show that fine-tuned LLMs effectively interpret decision rules and handle sophisticated considerations in a complex product scenario (automotive study), outperforming the best UDE models by capturing over 25% more information, while their performance in a moderate-scale study on mobile phones is comparable to the best UDE models. The use of LLMs enhances scalability, cost efficiency, and consistency in comprehending unstructured text data and making predictions, offering a promising alternative to human judges and enabling large-scale, real-time implementation of UDE in marketing research and practice. Together with their ability to interact with users, LLMs fine-tuned with representative datasets may serve as a valuable knowledgebase to summarize consumer preferences and decision rules and supply insights for the creation and simulation of marketing strategies.

Keywords: Unstructured elicitation; Decision rules; Decision prediction; Human agents; Large language models (LLMs); Fine-tune LLMs (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s40547-024-00151-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:custns:v:11:y:2024:i:1:d:10.1007_s40547-024-00151-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/40547

DOI: 10.1007/s40547-024-00151-4

Access Statistics for this article

Customer Needs and Solutions is currently edited by Min Ding

More articles in Customer Needs and Solutions from Springer, Institute for Sustainable Innovation and Growth (iSIG)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().