Information capacity of a network of spiking neurons

Silvia Scarpetta and Antonio de Candia

Physica A: Statistical Mechanics and its Applications, 2020, vol. 545, issue C

Abstract: We study a model of spiking neurons, with recurrent connections that result from learning a set of spatio-temporal patterns with a spike-timing dependent plasticity rule and a global inhibition. We investigate the ability of the network to store and selectively replay multiple patterns of spikes, with a combination of spatial population and phase-of-spike code. Each neuron in a pattern is characterized by a binary variable determining if the neuron is active in the pattern, and a phase-lag variable representing the spike-timing order among the active units. After the learning stage, we study the dynamics of the network induced by a brief cue stimulation, and verify that the network is able to selectively replay the pattern correctly and persistently. We calculate the information capacity of the network, defined as the maximum number of patterns that can be encoded in the network times the number of bits carried by each pattern, normalized by the number of synapses, and find that it can reach a value αmax≃0.27, similar to the one of sequence processing neural networks, and almost double of the capacity of the static Hopfield model. We study the dependence of the capacity on the global inhibition, connection strength (or neuron threshold) and fraction of neurons participating to the patterns. The results show that a dual population and temporal coding can be optimal for the capacity of an associative memory.

Keywords: Associative memory; Plasticity; Learning; Storage capacity; Neural networks; Spatiotemporal pattern replay (search for similar items in EconPapers)
Date: 2020
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437119320527
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:545:y:2020:i:c:s0378437119320527

DOI: 10.1016/j.physa.2019.123681

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().