THE IMPACT OF WEIGHTING PREFERENCES ON UNIVERSITY RANKINGS: THE EXAMPLE OF BULGARIA

Boyan Zahariev and Pepka Boyadjieva

Regional and Sectoral Economic Studies, 2012, vol. 12, issue 3

Abstract: On the basis of data from the official Bulgarian University Ranking System (BURS launched in 2011 and updated in 2012), the selection of weights for different indicators in a university ranking system is discussed. Weights represent the importance assigned to the different dimensions of performance measured through ranking, and can therefore be regarded as quantified value statements. Weight preferences differ across groups of stakeholders or even from one agent to another. In this paper a number of stochastic simulations using 4 initial sets of weights are made. The actual weights applied to BURS —simple uniform weights— are derived from a survey encompassing 15,000 university students as well as weights determined by university rectors. The results show that rankings, whose value is relatively neutral —with a set of weights closer to uniformity— are more vulnerable to small random fluctuations. Value laden rankings with asymmetric weights as in the case of BURS are more resilient to slight disturbance(s) however are very unstable in the case of the rearrangement of priorities. A consistent ranking system demands asymmetric weighting, which means strong value statements and prioritisation. The problem however with such a ranking system is that if heavily weighted preferences do not capture important elements of performance, the whole system can become not just marginally imprecise but also very erroneous.

Keywords: university rankings; selection of indicators; stochastic weights (search for similar items in EconPapers)
JEL-codes: I21 I23 (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.usc.es/economet/reviews/eers1235.pdf
No.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eaa:eerese:v:12:y2012:i:3_5

Ordering information: This journal article can be ordered from
http://www.usc.es/economet/info.htm

Access Statistics for this article

More articles in Regional and Sectoral Economic Studies from Euro-American Association of Economic Development
Bibliographic data for series maintained by M. Carmen Guisan ().