Using machine learning to select variables in data envelopment analysis: Simulations and application using electricity distribution data

Toni Duras, Farrukh Javed, Kristofer Månsson, Pär Sjölander and Magnus Söderberg

Energy Economics, 2023, vol. 120, issue C

Abstract: Agencies that regulate electricity providers often apply nonparametric data envelopment analysis (DEA) to assess the relative efficiency of each firm. The reliability and validity of DEA are contingent upon selecting relevant input variables. In the era of big (wide) data, the assumptions of traditional variable selection techniques are often violated due to challenges related to high-dimensional data and their standard empirical properties. Currently, regulators have access to a large number of potential input variables. Therefore, our aim is to introduce new machine learning methods for regulators of the energy market. We also propose a new two-step analytical approach where, in the first step, the machine learning-based adaptive least absolute shrinkage and selection operator (ALASSO) is used to select variables and, in the second step, selected variables are used in a DEA model. In contrast to previous research, we find, by using a more realistic data-generating process common for production functions (i.e., Cobb–Douglas and Translog), that the performance of different machine learning techniques differs substantially in different empirically relevant situations. Simulations also reveal that the ALASSO is superior to other machine learning and regression-based methods when the collinearity is low or moderate. However, in situations of multicollinearity, the LASSO approach exhibits the best performance. We also use real data from the Swedish electricity distribution market to illustrate the empirical relevance of selecting the most appropriate variable selection method.

Keywords: Data envelopment analysis; Curse of dimensionality; Machine learning; Variable selection; Regulation (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0140988323001196
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:eneeco:v:120:y:2023:i:c:s0140988323001196

DOI: 10.1016/j.eneco.2023.106621

Access Statistics for this article

Energy Economics is currently edited by R. S. J. Tol, Beng Ang, Lance Bachmeier, Perry Sadorsky, Ugur Soytas and J. P. Weyant

More articles in Energy Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().