Generalization in large committee machines

John Hertz and Holm Schwarze

Physica A: Statistical Mechanics and its Applications, 1993, vol. 200, issue 1, 563-569

Abstract: We study generalization in large committee machines. For a model with nonoverlapping receptive fields a full replica calculation yields results qualitatively similar to those for single-layer machines. For a fully connected architecture, within the annealed approximation we find a transition from a symmetric state to one with specialized hidden units, accompanied by a discontinuous drop in the generalization error, for both binary and continuous weights. The poorly generalizing symmetric states are metastable for arbitrarily large training sets.

Date: 1993
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/037843719390561H
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:200:y:1993:i:1:p:563-569

DOI: 10.1016/0378-4371(93)90561-H

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().