 An Evaluation of Experimental Designs for Constructing Vignette Sets in Factorial SurveysDan Su and Peter M. Steiner Sociological Methods & Research, 2020, vol. 49, issue 2, 455-497 Abstract: Factorial surveys use a population of vignettes to elicit respondents’ attitudes or beliefs about different hypothetical scenarios. However, the vignette population is frequently too large to be assessed by each respondent. Experimental designs such as randomized block confounded factorial (RBCF) designs, D-optimal designs, or random sampling designs can be used to construct small subsets of vignettes. In a simulation study, we compare the three vignette designs with respect to their biases in effect estimates and show how the biases arise from the designs’ confounding structure, nonorthogonality, and unbalancedness. We particularly focus on the designs’ sensitivity to context effects and misspecifications of the analytic model. We argue that RBCF designs and D-optimal designs are preferable to random sampling designs because they offer a stronger protection against undesirable confounding, context effects, and model misspecifications. We also discuss strategies for dealing with context and order effects since none of the basic vignette designs can satisfactorily handle them. Keywords: experimental design; factorial survey; vignette; context effect; confounding; confounded factorial design; D-optimal design; random sampling design (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:sae:somere:v:49:y:2020:i:2:p:455-497 Access Statistics for this article More articles in Sociological Methods & Research |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.