Consensus-Based Sub-Indicator Weighting Approach: Constructing Composite Indicators Compatible with Expert Opinion

Matheus Pereira Libório (), Lívia Maria Leite Silva (), Petr Iakovlevitch Ekel (), Letícia Ribeiro Figueiredo () and Patrícia Bernardes ()
Additional contact information
Matheus Pereira Libório: Pontifical Catholic University of Minas Gerais
Lívia Maria Leite Silva: Federal University of Minas Gerais
Petr Iakovlevitch Ekel: Pontifical Catholic University of Minas Gerais
Letícia Ribeiro Figueiredo: Pontifical Catholic University of Minas Gerais
Patrícia Bernardes: Pontifical Catholic University of Minas Gerais

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 2022, vol. 164, issue 3, No 4, 1073-1099

Abstract: Abstract The weighting of sub-indicators is a relevant problem in the composite indicators literature and impacts several fields of science. None of the existing weighting approaches, Equal-Weights, Data-Driven, and Participatory, is exempt from criticism. Specifically, weights obtained by the Participatory approach are associated with two frequent problems: assessments errors and international comparisons. Mainly, the assessments errors occur when the number of sub-indicators to be assessed is high, as it requires more cognitive effort from decision-makers. The problem of international comparison occurs because the weights of the sub-indicators reflect the specific characteristics of the countries and are not necessarily the same. Selecting experts who know the countries involved increases the impact of expert assessments on the results as the number of experts qualified to carry out the assessments decreases. These are common problems in composite indicators such as the Global Innovation Index, Multidimensional Poverty Index, Sustainable Development Goals Index, and Ease of Doing Business Index. This research presents solutions to these two problems. First, experts ordered seventeen sub-indicators by importance, decreasing the cognitive effort of the experts and the assessment errors that occur when the sub-indicators are assessed directly or compared in pairs. Second, the order of importance is converted into weights through six assessment format transformation functions. The deviant assessments are identified by the Concordance Correlation Coefficient and Intraclass Correlation Coefficient and excluded. Sub-indicators are weighted with a twenty-nine percent higher consensus degree, allowing the construction of composite indicators compatible with collective opinion.

Keywords: Composite indicators; Participatory weighting approach; Assessment formats; Transformation functions; Consensus degree (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11205-022-02989-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:soinre:v:164:y:2022:i:3:d:10.1007_s11205-022-02989-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11205-022-02989-4

Access Statistics for this article

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement is currently edited by Filomena Maggino

More articles in Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().