Consensus in the delphi method: What makes a decision change?

Maite Barrios, Georgina Guilera, Laura Nuño and Juana Gómez-Benito

Technological Forecasting and Social Change, 2021, vol. 163, issue C

Abstract: We examined whether giving feedback to participants in a Delphi study about the level of agreement across the expert panel had an effect on opinion change between rounds. We also considered the potential influence of participants’ sociodemographic and professional characteristics. Five three-round Delphi studies were conducted independently, in which a total of 628 mental health experts responded to all three rounds. In each study, participants had to decide, based on their experience, whether a series of categories were relevant. The percentage of group agreement (i.e., percentage of participants who considered each category as relevant) in round 2 was shown as feedback in round 3, and responses in rounds 2 and 3 were considered to analyze opinion change. Results showed that when the feedback given in round 3 indicated that ≥75% of experts considered a category to be relevant, there was a further shift in opinion towards the group opinion (i.e., the category then yielded even greater consensus), whereas if the feedback indicated <75% group agreement, individual opinions tended to shift against the group opinion (i.e., consensus over the category decreased). Neither sociodemographic nor professional variables had a significant effect in explaining opinion shift. These results show that in Delphi studies, feedback has an influence on individual responses and the achievement of consensus.

Keywords: Delphi method; Opinion change; Consensus threshold; Group agreement; Feedback effect (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S004016252031310X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:tefoso:v:163:y:2021:i:c:s004016252031310x

DOI: 10.1016/j.techfore.2020.120484

Access Statistics for this article

Technological Forecasting and Social Change is currently edited by Fred Phillips

More articles in Technological Forecasting and Social Change from Elsevier
Bibliographic data for series maintained by Catherine Liu ().