Deep Neural Network Memory Performance and Throughput Modeling and Simulation Framework

Freddy Gabbay (), Rotem Lev Aharoni and Ori Schweitzer
Additional contact information
Freddy Gabbay: Engineering Faculty, Ruppin Academic Center, Emek Hefer 4025000, Israel
Rotem Lev Aharoni: Electrical and Computer Engineering Faculty, Technion—Israel Institute of Technology, Haifa 3200003, Israel
Ori Schweitzer: Electrical and Computer Engineering Faculty, Technion—Israel Institute of Technology, Haifa 3200003, Israel

Mathematics, 2022, vol. 10, issue 21, 1-20

Abstract: Deep neural networks (DNNs) are widely used in various artificial intelligence applications and platforms, such as sensors in internet of things (IoT) devices, speech and image recognition in mobile systems, and web searching in data centers. While DNNs achieve remarkable prediction accuracy, they introduce major computational and memory bandwidth challenges due to the increasing model complexity and the growing amount of data used for training and inference. These challenges introduce major difficulties not only due to the constraints of system cost, performance, and energy consumption, but also due to limitations in currently available memory bandwidth. The recent advances in semiconductor technologies have further intensified the gap between computational hardware performance and memory systems bandwidth. Consequently, memory systems are, today, a major performance bottleneck for DNN applications. In this paper, we present DRAMA, a deep neural network memory simulator. DRAMA extends the SCALE-Sim simulator for DNN inference on systolic arrays with a detailed, accurate, and extensive modeling and simulation environment of the memory system. DRAMA can simulate in detail the hierarchical main memory components—such as memory channels, modules, ranks, and banks—and related timing parameters. In addition, DRAMA can explore tradeoffs for memory system performance and identify bottlenecks for different DNNs and memory architectures. We demonstrate DRAMA’s capabilities through a set of experimental simulations based on several use cases.

Keywords: machine learning; deep neural networks; systolic array; memory hierarchy; DRAM memory; performance simulation (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/21/4144/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/21/4144/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:21:p:4144-:d:964761

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().