Assessing Validity and Test-Retest Reliability for “Pick of ” Data

David C. Schmittlein
Additional contact information
David C. Schmittlein: The Wharton School

Marketing Science, 1984, vol. 3, issue 1, 23-40

Abstract: A mixed binomial error model is proposed which permits the evaluation of validity and test-retest reliability when individuals are asked to pick of objects. The approach explicitly incorporates the effect of guessing as well as the respondent's true discrimination ability, and recognizes that that ability will vary across respondents. So, given the choices made by a set of individuals, we are interested in estimating the distribution of true ability over the population. To evaluate the criterion-related validity each person's choices (of objects) are compared to an objective standard—the “correct” choices. For the primary model considered here these data can be summarized by the distribution, over individuals, of the number of “matches” or agreements between a person's choices and the objective criterion. A similar procedure is used for evaluating test-retest reliability. The distribution for the number of matches is again used; but here the matches will refer to agreement between the individual's choices on this occasion, and the choices made by that individual on a previous occasion. The use of these reliability and validity results to address specific marketing questions, such as the segmentability of a market or the effect of advertising on perception and attitudes, is also discussed.

Keywords: pick of data; correcting for guessing; criterion-related validity; test-retest reliability (search for similar items in EconPapers)
Date: 1984
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/mksc.3.1.23 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormksc:v:3:y:1984:i:1:p:23-40

Access Statistics for this article

More articles in Marketing Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().