Active learning strategies for interactive elicitation of assignment examples for threshold-based multiple criteria sorting

Miłosz Kadziński and Krzysztof Ciomek

European Journal of Operational Research, 2021, vol. 293, issue 2, 658-680

Abstract: We consider an interactive elicitation of holistic preference information for multiple criteria sorting approached with a threshold-based value-driven procedure. We introduce several active learning strategies for selecting, in each stage of interaction, an alternative that the Decision Maker (DM) should assign to its desired class. To identify the best assignment-based question, we evaluate each candidate alternative in terms of either ambiguity in its possible assignments at the current stage of interaction or its potential contribution to reducing uncertainty in the assignments of all alternatives once the question is answered. The performance of the proposed heuristic strategies is experimentally verified in view of computational time as well as the average and maximal numbers of questions that need to be answered by the DM until the classification recommended by all compatible preference models is sufficiently robust. We demonstrate that competitive results can be obtained with the heuristics that select the next question based on the analysis of current classification results as compared to the strategies looking ahead the current stage, which takes significantly more time. We also show how the performance of the questioning strategies is affected when, e.g., considering various problem sizes, imposing different stopping criteria for the preference elicitation, or reducing the flexibility of an assumed preference model by fixing the class thresholds.

Keywords: Multiple criteria analysis; Multiple criteria sorting; Active learning; Preference elicitation; Interactive methods (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221720311012
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:293:y:2021:i:2:p:658-680

DOI: 10.1016/j.ejor.2020.12.055

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().