Multiple-criteria performance ranking based on profile distributions: An application to university research evaluations

Pierre L. Kunsch and Alessio Ishizaka

Mathematics and Computers in Simulation (MATCOM), 2018, vol. 154, issue C, 48-64

Abstract: This article addresses a category of multi-criteria ranking problems in which performance evaluations of the ‘objects’ or ‘alternatives’ to be ranked are not given by unique numbers but by performance profile distributions running over an ordered set of performance score levels. The numerical values to be given to score levels are not specified a priori using cardinal scales. A weighted sum approach is developed based on order statistics to combine the individual profile distributions. In this way, a global ranking indicator is obtained, considering not only mean distribution values but also standard deviations. As a test of feasibility, the resulting Profile Ranking with Order Statistics Evaluations (PROSE) approach has been applied to the performance profile distributions provided by the UK Research Excellence Framework 2014, evaluating the quality of UK research.

Keywords: Multi-criteria ranking; Performance profiles; Order statistics; Ranking indicator; 2014 Research Excellence Framework (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378475418301459
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:154:y:2018:i:c:p:48-64

DOI: 10.1016/j.matcom.2018.05.021

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().