A dynamic connectome supports the emergence of stable computational function of neural circuits through reward-based learning

David Kappel*, Robert Legenstein, Stefan Habenschuss, Michael Hsieh, Wolfgang Maass

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapseautonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations.

Original languageEnglish
Article numbere0301-17.2018
Number of pages27
JournaleNeuro
Volume5
Issue number2
DOIs
Publication statusPublished - 1 Mar 2018

Keywords

  • Reward-modulated STDP
  • Spine dynamics
  • Stochastic synaptic plasticity
  • Synapse-autonomous processes
  • Synaptic rewiring
  • Task-irrelevant dimensions in motor control

ASJC Scopus subject areas

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'A dynamic connectome supports the emergence of stable computational function of neural circuits through reward-based learning'. Together they form a unique fingerprint.

Cite this