Gremlins in the Data: Identifying the Information Content of Research Subjects

John R. Howell (), Peter Ebbes (), John Liechty () and Porter Jenkins ()

No 1223, HEC Research Papers Series from HEC Paris

Abstract: Empirical demand functions (based on experimental studies, such as Choice Based Conjoint) are critical to many aspects of marketing, such as targeting and segmentation, setting prices and evaluating the potential of new products. While considerable work has been done on developing approaches for ensuring that research subjects are both honest and engaged, the reduced cost associated with collecting data in an online setting has driven many studies to be collected under conditions which leave researchers unsure of the value of the information content provided by each subject. Objective measures related to how the subject completes the study, such as latency (how quickly answers are given), can only be tied to other objective measures (such as the fit of the model or consistency of the answer) and ultimately have questionable relationship to the subject's utility function. In response to this problem, we introduce a mixture modeling framework which clusters subjects based on variances in a choice based setting (multinomial logit models). This model naturally groups subjects based on the internal consistency of their answers, where we argue that a higher level of internal consistence (hence lower variance) reflects more engaged consumers who have sufficient experience with the product category and choice task, to have well-formed utilities. This approach provides an automated way of determining which consumers are relevant. We discuss both the modeling framework and illustrate the methods using data from several commercial conjoint studies.

Keywords: Multinomial Logit; Conjoint Analysis; Data Quality; Finite Mixture Models (search for similar items in EconPapers)
JEL-codes: M31 (search for similar items in EconPapers)
Pages: 50 pages
Date: 2017-08-08
New Economics Papers: this item is included in nep-upt
References: Add references at CitEc
Citations:

Downloads: (external link)
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3018425 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ebg:heccah:1223

DOI: 10.2139/ssrn.3018425

Access Statistics for this paper

More papers in HEC Research Papers Series from HEC Paris HEC Paris, 78351 Jouy-en-Josas cedex, France. Contact information at EDIRC.
Bibliographic data for series maintained by Antoine Haldemann ().