A Hardware Instruction Generation Mechanism for Energy-Efficient Computational Memories - Département Systèmes et Circuits Intégrés Numériques
Communication Dans Un Congrès Année : 2024

A Hardware Instruction Generation Mechanism for Energy-Efficient Computational Memories

Résumé

In the Computing-In-Memory (CIM) approach, computations are directly performed within the data storage unit, which often results in energy reduction. This makes it particularly well fitted for embedded systems, highly constrained in energy efficiency. It is commonly admitted that this energy reduction comes from less data transfers between the CPU and the main memory. Nevertheless, preparing and sending instructions to the computational memory also consumes energy and time, hence limiting overall performance. In this paper, we present a hardware instruction generation mechanism integrated in computational memories and evaluate its benefit for Integer General Matrix Multiplication (IGeMM) operations. The proposed mechanism is implemented in the computational memory controller and translates macro-instructions into corresponding micro-instructions needed to execute the kernel on stored data. We modified an existing near-memory computing architecture and extracted corresponding energy consumption figures using post-layout simulations for the complete SoC. Our proposed architecture, NEar memory computing Macro Instructions Kernal Accelerator (NeMIKA), provides an 8.2x speed-up and a 4.6x energy consumption reduction compared to a state-of-the-art CIM accelerator based on micro-instructions, while inducing an area overhead of only 0.1%.
Fichier sous embargo
Fichier sous embargo
0 3 13
Année Mois Jours
Avant la publication
jeudi 2 janvier 2025
Fichier sous embargo
jeudi 2 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

cea-04676665 , version 1 (23-08-2024)

Licence

Identifiants

Citer

Léo de la Fuente, Jean-Frédéric Christmann, Manuel Pezzin, Matthias Remars, Olivier Sentieys. A Hardware Instruction Generation Mechanism for Energy-Efficient Computational Memories. ISCAS 2024 - IEEE International Symposium on Circuits and Systems, May 2024, Singapour, Singapore. ⟨10.1109/ISCAS58744.2024.10557870⟩. ⟨cea-04676665⟩
16 Consultations
3 Téléchargements

Altmetric

Partager

More