An experimental design for comparing interactive methods based on their desirable properties

Bekir Afsar (), Johanna Silvennoinen (), Francisco Ruiz (), Ana B. Ruiz (), Giovanni Misitano () and Kaisa Miettinen ()
Additional contact information
Bekir Afsar: University of Jyvaskyla, Faculty of Information Technology
Johanna Silvennoinen: University of Jyvaskyla, Faculty of Information Technology
Francisco Ruiz: Universidad de Málaga
Ana B. Ruiz: Universidad de Málaga
Giovanni Misitano: University of Jyvaskyla, Faculty of Information Technology
Kaisa Miettinen: University of Jyvaskyla, Faculty of Information Technology

Annals of Operations Research, 2024, vol. 338, issue 2, No 1, 835-856

Abstract: Abstract In multiobjective optimization problems, Pareto optimal solutions representing different tradeoffs cannot be ordered without incorporating preference information of a decision maker (DM). In interactive methods, the DM takes an active part in the solution process and provides preference information iteratively. Between iterations, the DM can learn how achievable the preferences are, learn about the tradeoffs, and adjust the preferences. Different interactive methods have been proposed in the literature, but the question of how to select the best-suited method for a problem to be solved remains partly open. We propose an experimental design for evaluating interactive methods according to several desirable properties related to the cognitive load experienced by the DM, the method’s ability to capture preferences and its responsiveness to changes in the preferences, the DM’s satisfaction in the overall solution process, and their confidence in the final solution. In the questionnaire designed, we connect each questionnaire item to be asked with a relevant research question characterizing these desirable properties of interactive methods. We also conduct a between-subjects experiment to compare three interactive methods and report interesting findings. In particular, we find out that trade-off-free methods may be more suitable for exploring the whole set of Pareto optimal solutions, while classification-based methods seem to work better for fine-tuning the preferences to find the final solution.

Keywords: Multiple criteria optimization; Interactive methods; Performance comparison; Empirical experiments; Human decision makers (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10479-024-05941-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:annopr:v:338:y:2024:i:2:d:10.1007_s10479-024-05941-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10479

DOI: 10.1007/s10479-024-05941-6

Access Statistics for this article

Annals of Operations Research is currently edited by Endre Boros

More articles in Annals of Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().