Signal-to-noise analysis of Hopfield neural networks with a formulation of the dynamics in terms of transition probabilities

F. Reynaga

Physica A: Statistical Mechanics and its Applications, 2009, vol. 388, issue 23, 4872-4886

Abstract: We study Hopfield neural networks with infinite connectivity using signal-to-noise analysis with a formulation of the dynamics in terms of transition probabilities. We focus our study on models where the strongest effects of the feedback correlations appear. We introduce an analysis of the path probability of one neuron in order to obtain the contribution of all feedback correlations to the dynamics of this neuron. In this way, we obtain a complete theory for dynamics with order parameter equations identical to those obtained with general functional analysis for finite temperature. In the first part of this work, we present our method in the fully connected Little-Hopfield neural network. We obtain, in a simple and direct way, the order parameter equations found by general functional analysis. In the second part, the exposed method is applied to the fully connected Ashkin-Teller neural network. It is shown that the retrieval quality is improved by introducing four-spin couplings. Simulation results support our theoretical predictions.

Keywords: Neural networks; Statistical mechanics; Probability theory (search for similar items in EconPapers)
Date: 2009
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S037843710900613X
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:388:y:2009:i:23:p:4872-4886

DOI: 10.1016/j.physa.2009.08.004

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().