 Hybrid learning schemes for fast training of feed-forward neural networksNicolaos B. Karayiannis Mathematics and Computers in Simulation (MATCOM), 1996, vol. 41, issue 1, 13-28 Abstract: Fast training of feed-forward neural networks became increasingly important as the neural network field moves toward maturity. This paper begins with a review of various criteria proposed for training feed-forward neural networks, which include the frequently used quadratic error criterion, the relative entropy criterion, and a generalized training criterion. The minimization of these criteria using the gradient descent method results in a variety of supervised learning algorithms. The performance of these algorithms in complex training tasks is strongly affected by the initial set of internal representations, which are usually formed by a randomly generated set of synaptic weights. The convergence of gradient descent based learning algorithms in complex training tasks can be significantly improved by initializing the internal representations using an unsupervised learning process based on linear or nonlinear generalized Hebbian learning rules. The efficiency of the hybrid learning scheme presented in this paper is illustrated through experimental results. Date: 1996 Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:41:y:1996:i:1:p:13-28 DOI: 10.1016/0378-4754(95)00055-0 Access Statistics for this article Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.