Hybrid Neural Network Training on Diverse Hardware

Fabian Arun Panaite and Monica Leba

A chapter in Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference, Hybrid Conference, Dubrovnik, Croatia, 5-7 September, 2024, 2025, pp 280-288 from IRENET - Society for Advancing Innovation and Research in Economy, Zagreb

Abstract: This study presents a comprehensive comparison of neural network training hardware structures, focusing on the performance of CPU and GPU processors under varying data storage conditions (SSD drive and RAM disk). Initially, the training efficiency and speed of neural networks are analysed using a CPU processor, with data stored first on an SSD drive and subsequently in a RAM disk to evaluate the impact of data retrieval speeds on training times and accuracy. The analysis is then extended to GPU processors, renowned for their superior parallel processing capabilities, under identical data storage conditions to discern the benefits and limitations of each hardware setup in neural network training scenarios. Additionally, a novel hybrid architecture is proposed, combining either CPU or GPU processors with the concept of memory sprites-a technique borrowed from the age of video game development for optimizing graphics on less capable hardware. This approach aims to leverage the advantages of both processing units while mitigating their weaknesses, offering a potentially superior solution for training complex neural networks efficiently on diverse hardware platforms.

Keywords: Neural Networks; CPU; GPU; SSD; RAM; memory sprites (search for similar items in EconPapers)
JEL-codes: L63 L86 (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/317966/1/entrenova-2024-0023.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:entr24:317966

DOI: 10.54820/entrenova-2024-0023

Access Statistics for this chapter

More chapters in Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference (2024), Hybrid Conference, Dubrovnik, Croatia from IRENET - Society for Advancing Innovation and Research in Economy, Zagreb
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().