Multi-criteria Decision-Making Techniques for the Selection of Pareto-optimal Machine Learning Models in a Drinking-Water Quality Monitoring Problem

V. Henrique Alves Ribeiro and G. Reynoso-Meza
Additional contact information
V. Henrique Alves Ribeiro: Programa de Pós-Graduação em Engenharia de Produção e Sistemas (PPGEPS), Pontifícia Universidade Católica do Paraná (PUCPR), Brazil
G. Reynoso-Meza: Programa de Pós-Graduação em Engenharia de Produção e Sistemas (PPGEPS), Pontifícia Universidade Católica do Paraná (PUCPR), Brazil

International Journal of Information Technology & Decision Making (IJITDM), 2024, vol. 23, issue 01, 447-474

Abstract: Machine learning algorithms are valuable tools for solving a wide variety of complex engineering problems. Usually, those problems have multiple criteria to fulfill, but such machine learning-based solutions are usually optimized using a single criterion. In such instances, a multi-objective optimization-based approach could bring interesting solutions by determining a set of Pareto-optimal solutions with different trade-off. Therefore, a multi-criteria decision-making process must be carried out. To the authors’ present knowledge, multi-criteria decision-making is yet to be fully explored for selecting preferable Pareto-optimal machine learning models after the training step. Therefore, this paper proposes applying and comparing five different multi-criteria decision-making techniques for selecting a preferred machine learning model. Additionally, an ensemble-based framework is proposed to cope with the difficulty of selecting parameters for such techniques. Those tools are tested on a complex real-world drinking-water quality monitoring problem. Results based on the F1 score indicate that via a multi-criteria decision-making process (F1=0.56), it is possible to select better solutions than single-criterion approaches (F1=0.55). Moreover, the proposed ensemble framework is able to mitigate the difficulty in defining preferences and regions of interest, achieving competitive solutions.

Keywords: Multi-criteria decision making; multi-objective optimization; machine learning; water quality monitoring; fault detection (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622023500104
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:23:y:2024:i:01:n:s0219622023500104

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219622023500104

Access Statistics for this article

International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi

More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().