A simulation study on the probabilities of rank reversal, tie making, and tie breaking for multiple criteria decision making methods

Lisheng Jiang, Huchang Liao and Bernard De Baets

Omega, 2024, vol. 125, issue C

Abstract: Multiple criteria decision making (MCDM) methods can be affected by preference reversal, meaning that the order of two alternatives is reversed after adding or deleting another alternative. Here, we focus on methods that produce rankings with ties (i.e., weak orders). In this context, one usually talks about rank reversal. Existing rank reversal probability simulation experiments are subject to improvement on the following points: (1) the small number of MCDM methods included, (2) the unclear relation between the rank reversal probability and the rank of the deleted alternative, and (3) the lack of consideration of ties. In this paper, considering both strict preferences and ties, we distinguish two new phenomena: tie breaking, i.e., the shift from a tie to a strict preference, and tie making, i.e., the shift from a strict preference to a tie. To investigate the probabilities of rank reversal, tie making, and tie breaking, a simulation study involving thirty versions of twelve MCDM methods and six simulation factors is set up. Results demonstrate that for MCDM methods using pairwise comparison data, deleting an alternative ranked first or last leads to smaller probabilities than deleting an alternative in the middle, while the opposite holds for the methods using evaluation data under criteria. Four findings and three suggestions are given to help decision makers select MCDM methods to use.

Keywords: Multiple criteria decision making; Rank reversal; Rank-based probability; Tie breaking; Tie making (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0305048323001974
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jomega:v:125:y:2024:i:c:s0305048323001974

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.omega.2023.103033

Access Statistics for this article

Omega is currently edited by B. Lev

More articles in Omega from Elsevier
Bibliographic data for series maintained by Catherine Liu ().