A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition

Robert Legenstein, Zeno Jonke, Stefan Habenschuss, Wolfgang Maass

Research output: Contribution to journalArticleResearch

Abstract

Previous theoretical studies on the interaction of excitatory and inhibitory neurons proposed to model this cortical microcircuit motif as a so-called Winner-Take-All (WTA) circuit. A recent modeling study however found that the WTA model is not adequate for data-based softer forms of divisive inhibition as found in a microcircuit motif in cortical layer 2/3. We investigate here through theoretical analysis the role of such softer divisive inhibition for the emergence of computational operations and neural codes under spike-timing dependent plasticity (STDP). We show that in contrast to WTA models - where the network activity has been interpreted as probabilistic inference in a generative mixture distribution - this network dynamics approximates inference in a noisy-OR-like generative model that explains the network input based on multiple hidden causes. Furthermore, we show that STDP optimizes the parameters of this model by approximating online the expectation maximization (EM) algorithm. This theoretical analysis corroborates a preceding modelling study which suggested that the learning dynamics of this layer 2/3 microcircuit motif extracts a specific modular representation of the input and thus performs blind source separation on the input statistics.
Original languageEnglish
Pages (from-to)1-27
Number of pages24
JournalarXiv.org e-Print archive
DOIs
Publication statusPublished - 17 Jul 2017

Fingerprint

Plasticity
Blind source separation
Electric power distribution
Neurons
Statistical Models
Statistics
Networks (circuits)

Cite this

A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition. / Legenstein, Robert; Jonke, Zeno; Habenschuss, Stefan; Maass, Wolfgang.

In: arXiv.org e-Print archive, 17.07.2017, p. 1-27.

Research output: Contribution to journalArticleResearch

@article{cc0d0a78a7c34ea7a84681c3394c208c,
title = "A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition",
abstract = "Previous theoretical studies on the interaction of excitatory and inhibitory neurons proposed to model this cortical microcircuit motif as a so-called Winner-Take-All (WTA) circuit. A recent modeling study however found that the WTA model is not adequate for data-based softer forms of divisive inhibition as found in a microcircuit motif in cortical layer 2/3. We investigate here through theoretical analysis the role of such softer divisive inhibition for the emergence of computational operations and neural codes under spike-timing dependent plasticity (STDP). We show that in contrast to WTA models - where the network activity has been interpreted as probabilistic inference in a generative mixture distribution - this network dynamics approximates inference in a noisy-OR-like generative model that explains the network input based on multiple hidden causes. Furthermore, we show that STDP optimizes the parameters of this model by approximating online the expectation maximization (EM) algorithm. This theoretical analysis corroborates a preceding modelling study which suggested that the learning dynamics of this layer 2/3 microcircuit motif extracts a specific modular representation of the input and thus performs blind source separation on the input statistics.",
author = "Robert Legenstein and Zeno Jonke and Stefan Habenschuss and Wolfgang Maass",
year = "2017",
month = "7",
day = "17",
doi = "10.1103/PhysRevD.96.084033",
language = "English",
pages = "1--27",
journal = "arXiv.org e-Print archive",
publisher = "Cornell University Library",

}

TY - JOUR

T1 - A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition

AU - Legenstein, Robert

AU - Jonke, Zeno

AU - Habenschuss, Stefan

AU - Maass, Wolfgang

PY - 2017/7/17

Y1 - 2017/7/17

N2 - Previous theoretical studies on the interaction of excitatory and inhibitory neurons proposed to model this cortical microcircuit motif as a so-called Winner-Take-All (WTA) circuit. A recent modeling study however found that the WTA model is not adequate for data-based softer forms of divisive inhibition as found in a microcircuit motif in cortical layer 2/3. We investigate here through theoretical analysis the role of such softer divisive inhibition for the emergence of computational operations and neural codes under spike-timing dependent plasticity (STDP). We show that in contrast to WTA models - where the network activity has been interpreted as probabilistic inference in a generative mixture distribution - this network dynamics approximates inference in a noisy-OR-like generative model that explains the network input based on multiple hidden causes. Furthermore, we show that STDP optimizes the parameters of this model by approximating online the expectation maximization (EM) algorithm. This theoretical analysis corroborates a preceding modelling study which suggested that the learning dynamics of this layer 2/3 microcircuit motif extracts a specific modular representation of the input and thus performs blind source separation on the input statistics.

AB - Previous theoretical studies on the interaction of excitatory and inhibitory neurons proposed to model this cortical microcircuit motif as a so-called Winner-Take-All (WTA) circuit. A recent modeling study however found that the WTA model is not adequate for data-based softer forms of divisive inhibition as found in a microcircuit motif in cortical layer 2/3. We investigate here through theoretical analysis the role of such softer divisive inhibition for the emergence of computational operations and neural codes under spike-timing dependent plasticity (STDP). We show that in contrast to WTA models - where the network activity has been interpreted as probabilistic inference in a generative mixture distribution - this network dynamics approximates inference in a noisy-OR-like generative model that explains the network input based on multiple hidden causes. Furthermore, we show that STDP optimizes the parameters of this model by approximating online the expectation maximization (EM) algorithm. This theoretical analysis corroborates a preceding modelling study which suggested that the learning dynamics of this layer 2/3 microcircuit motif extracts a specific modular representation of the input and thus performs blind source separation on the input statistics.

UR - https://arxiv.org/abs/1707.05182

U2 - 10.1103/PhysRevD.96.084033

DO - 10.1103/PhysRevD.96.084033

M3 - Article

SP - 1

EP - 27

JO - arXiv.org e-Print archive

JF - arXiv.org e-Print archive

ER -