Effect of Architecture and Inference Parameters of Artificial Neural Network Models in the Detection Task on Energy Demand

Paweł Tomiło (), Piotr Oleszczuk, Agnieszka Laskowska, Weronika Wilczewska and Ernest Gnapowski
Additional contact information
Paweł Tomiło: Faculty of Management, Lublin University of Technology, 20-618 Lublin, Poland
Piotr Oleszczuk: Faculty of Management, Lublin University of Technology, 20-618 Lublin, Poland
Agnieszka Laskowska: Faculty of Management, Lublin University of Technology, 20-618 Lublin, Poland
Weronika Wilczewska: Faculty of Management, Lublin University of Technology, 20-618 Lublin, Poland
Ernest Gnapowski: Faculty of Mathematics and Information Technology, Lublin University of Technology, 20-618 Lublin, Poland

Energies, 2024, vol. 17, issue 21, 1-18

Abstract: Artificial neural network models for the task of detection are used in many fields and find various applications. Models of this kind require adequate computational resources and thus require adequate energy expenditure. The increase in the number of parameters, the complexity of architectures, and the need to process large data sets significantly increase energy consumption, which is becoming a key sustainability challenge. Optimization of computing and the development of energy-efficient hardware technologies are essential to reduce the energy footprint of these models. This article examines the effect of the type of model, as well as its parameters, on energy consumption during inference. For this purpose, sensors built into the graphics card were used, and software was developed to measure the energy demand of the graphics card for different architectures of YOLO models (v8, v9, v10), as well as for different batch and model sizes. This study showed that the increase in energy demand is not linearly dependent on batch size. After a certain level of batch size, the energy demand begins to decrease. This dependence does not occur only for n/t size models. Optimum utilization of computing power due to the number of processed images for the studied models occurs at the maximum studied batch size. In addition, tests were conducted on an embedded device.

Keywords: artificial neural networks; object detection; energy consumption; application scenarios; optimization of energy consumption (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/17/21/5417/pdf (application/pdf)
https://www.mdpi.com/1996-1073/17/21/5417/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:17:y:2024:i:21:p:5417-:d:1510243

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().