Deep learning incorporating biologically inspired neural dynamics and in-memory computing

Stanislaw Woźniak, Angeliki Pantazi, Thomas Bohnstingl, Evangelos Eleftheriou

Research output: Contribution to journalArticle

Abstract

Spiking neural networks (SNNs) incorporating biologically plausible neurons hold great promise because of their unique temporal dynamics and energy efficiency. However, SNNs have developed separately from artificial neural networks (ANNs), limiting the impact of deep learning advances for SNNs. Here, we present an alternative perspective of the spiking neuron that incorporates its neural dynamics into a recurrent ANN unit called a spiking neural unit (SNU). SNUs may operate as SNNs, using a step function activation, or as ANNs, using continuous activations. We demonstrate the advantages of SNU dynamics through simulations on multiple tasks and obtain accuracies comparable to, or better than, those of ANNs. The SNU concept enables an efficient implementation with in-memory acceleration for both training and inference. We experimentally demonstrate its efficacy for a music-prediction task in an in-memory-based SNN accelerator prototype using 52,800 phase-change memory devices. Our results open up an avenue for broad adoption of biologically inspired neural dynamics in challenging applications and acceleration with neuromorphic hardware.
Original languageEnglish
Pages (from-to)325 - 336
JournalNature Machine Intelligence
Volume2
DOIs
Publication statusPublished - 15 Jun 2020

Fingerprint Dive into the research topics of 'Deep learning incorporating biologically inspired neural dynamics and in-memory computing'. Together they form a unique fingerprint.

Cite this