Examination of the similarity between a new Sigmoid function-based consensus ranking method and four commonly-used algorithms

Madjid Tavana, Frank LoPinto and James W. Smither

International Journal of Operational Research, 2008, vol. 3, issue 4, 384-398

Abstract: The problem of aggregating individual rankings to create an overall consensus ranking representative of the group is of longstanding interest in group decision making. The problem arises in situations where a group of k Decision Makers (DMs) are asked to rank order n alternatives. The question is how to combine the DMs' rankings into one consensus ranking. Several different approaches have been suggested to aggregate DM responses into a compromise or consensus ranking, however, none is generally recognised as being the best and the similarity of consensus rankings generated by these algorithms is largely unknown. In this paper, we propose a new Weighted-sum ordinal Consensus ranking Method (WCM) with the weights derived from a Sigmoid function. We run Monte Carlo simulation across a range of k and n to compare the similarity of the consensus rankings generated by our method with the best-known method of Borda–Kendall (BAK; Kendall, M. (1962) Rank correlation methods. New York, NY: Hafner) and two other commonly used techniques proposed by Beck, M.P. and Lin, B.W. (1983) 'Some heuristics for the consensus ranking problem', Computers and Operations Research, Vol. 10, pp.1–7 and Cook, W.D. and Kress, M. (1985) 'Ordinal rankings with intensity of preference', Management Science, Vol. 31, pp.26–32. WCM and BAK yielded the most similar consensus rankings (mean tau-x = .91). As the number of alternatives to be ranked increased, the similarity of rankings generated by the four algorithms decreased. Although consensus rankings generated by different algorithms were similar, differences in rankings among the algorithms were of sufficient magnitude that they often cannot be viewed as interchangeable from a practical perspective.

Keywords: function-based consensus ranking; group decisions; Monte Carlo; ordinal; preference; voting; decision making; Sigmoid function. (search for similar items in EconPapers)
Date: 2008
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=19000 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijores:v:3:y:2008:i:4:p:384-398

Access Statistics for this article

More articles in International Journal of Operational Research from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().