EVALUATION OF THE PERFORMANCE OF AUTOMATED MACHINE LEARNING TOOLS

Desislava Koleva () and Yanka Aleksandrova ()
Additional contact information
Desislava Koleva: University of Economics - Varna / Department of Informatics, Varna, Bulgaria
Yanka Aleksandrova: University of Economics - Varna / Department of Informatics, Varna, Bulgaria

Conferences of the department Informatics, 2024, issue 1, 63-70

Abstract: The ubiquitous application of predictive models has created the demand for optimized ways of building, deploying and enhancing machine learning models. Traditionally building and deploying machine learning models require the involvement of highly classified data scientists with good knowledge about machine learning algorithms, specialized programming languages, mathematics, statistics and data engineering. The relatively new and developing area of automated machine learning (AutoML) has made the whole process of building and deploying an AI model more accessible and automated by providing solutions for automated machine learning pipeline encompassing data collection, preprocessing, feature selection, model building and hyperparameter tuning. Automated machine learning tools allow for business users that are not necessarily machine learning experts to develop and implement high quality predictive models. The purpose of this research paper is to assess and compare AutoML tools for solving classification problems. One of the leading AutoML tools are chosen like Azure Automated Machine Learning, Amazon Sage Maker Auto Pilot, H2O AutoML, H2O Flow and Altair AI Studio Auto Model. Classification models using AutoML tools are trained on a dataset for customer churn predictions and models are compared based on previously chosen measures. AutoML tools are also assessed on different criteria like ease of use, functionality, user orientation, limitations and generated output format. Results show remarkable predictive performance of the generated classification models in general. The best trained classification models are ensemble models trained in Amazon Sage Maker Auto Pilot and H2O AutoML. Some conclusions and recommendations have been drawn to help data science practitioners with choosing and implementing automated machine learning tools.

Keywords: AutoML; automated machine learning; Azure; Amazon SageMaker; H2O; Altair (search for similar items in EconPapers)
JEL-codes: C8 (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://informatics.ue-varna.bg/ICTBE2024/ICTBE2024_63-70.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrn:katinf:y:2024:i:1:p:63-70

Access Statistics for this article

Conferences of the department Informatics is currently edited by Vladimir Sulov

More articles in Conferences of the department Informatics from Publishing house Science and Economics Varna Contact information at EDIRC.
Bibliographic data for series maintained by Vladimir Sulov ().