Pooling Rankings to Obtain a Set of Scores for a Composite Indicator of Erasmus + Mobility Effects

Luigi Fabbris () and Manuela Scioni ()
Additional contact information
Luigi Fabbris: University of Padova
Manuela Scioni: University of Padova

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 2021, vol. 156, issue 2, No 8, 497 pages

Abstract: Abstract In this paper, we study how to assign weights to a set of evaluations obtained at the end of an international mobility experience in order to aggregate them into a composite indicator. The mobility experience was evaluated by three categories of actor: the participant; the school or company sending the participant; and the school or company hosting the participant. We estimated the weights starting from the assessors’ mutual evaluations of the beneficiaries of the mobility experiences. In particular, the aim of the paper was to compare two strategies for estimating the weights: (1) a weighted function of the univariate rank distribution of frequencies; and (2) the normalised elements of the first eigenvector of the dominance matrix computed by mediating the actors’ dominance matrices derived from the rankings of mobility beneficiaries. Variants of the two strategies were also introduced. Even though each strategy had different assumptions, the analyses produced several important findings. First, the optimum weighting model depends on the loss function used to evaluate the quality of the results. In particular a between-ranking variability function favours both univariate and unweighted multivariate models, while a bias-based function favours weighted multivariate models. Second, in both univariate and multivariate analyses, the application of rank-order-centroid and rank-reciprocal rules give more accurate results than both linear and exponential rules.

Keywords: Aggregation of rankings; Score estimation; Composite indicator; Weighting system; Dominance matrix (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11205-020-02513-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:soinre:v:156:y:2021:i:2:d:10.1007_s11205-020-02513-6

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11205-020-02513-6

Access Statistics for this article

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement is currently edited by Filomena Maggino

More articles in Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().