Facing the Experts: Survey Mode and Expert Elicitation

Erin Baker, Valentina Bosetti, Karen E. Jenni and Elena Claire Ricci
Additional contact information
Erin Baker: University of Massachusetts at Amherst
Karen E. Jenni: Insight Decisions LLC
Elena Claire Ricci: Fondazione Eni Enrico Mattei, Centro Euro-Mediterraneo per i Cambiamenti Climatici and Università degli Studi di Milano

No 2014.01, Working Papers from Fondazione Eni Enrico Mattei

Abstract: In this paper we compare the results of two different expert elicitation methods: in-person interviews and a self-administered web-based survey. Traditional expert elicitation has been done face to face, with an elicitor meeting with an expert for a few hours to several days, depending on the complexity of the analysis. Recently, however, some groups have been using other methods to solicit expert judgments, including self-administered surveys (written, emailed, and web-based), and the use of interactive web tools to facilitate interactions during an elicitation. These elicitations require fewer resources from the assessment team than in-person interviews, and often allow participating experts to provide input on their own schedules, perhaps with additional time to think about their responses. Thus they open up the possibility of using expert elicitation to obtain inputs relevant to a broader set of decisions. To our knowledge, these newer survey-based methods have not been rigorously evaluated for efficacy. We find, much like the results in the literature on different survey modes, different results from two different modes we examined, but no clear indication of which method might be preferred. We suggest future work including some controlled, lab-based experiments and real EEs well designed to avoid sample selection biases and specifically targeted to capture survey mode effects. Such studies would help us determine whether and when the different survey modes are most effective.

Keywords: Expert Elicitation; Interviews; Web Surveys; Carbon Capture and Storage (search for similar items in EconPapers)
JEL-codes: D81 O32 Q40 Q55 (search for similar items in EconPapers)
Date: 2014-01
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
https://feem-media.s3.eu-central-1.amazonaws.com/w ... oads/NDL2014-001.pdf (application/pdf)

Related works:
Working Paper: Facing the Experts: Survey Mode and Expert Elicitation (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fem:femwpa:2014.01

Access Statistics for this paper

More papers in Working Papers from Fondazione Eni Enrico Mattei Contact information at EDIRC.
Bibliographic data for series maintained by Alberto Prina Cerai ( this e-mail address is bad, please contact ).