Research on the Classification Ability of Deep Belief Networks on Small and Medium Datasets

Bondarenko Andrey () and Borisov Arkady ()

Information Technology and Management Science, 2013, vol. 16, issue 1, 60-65

Abstract: Recent theoretical advances in the learning of deep artificial neural networks have made it possible to overcome a vanishing gradient problem. This limitation has been overcome using a pre-training step, where deep belief networks formed by the stacked Restricted Boltzmann Machines perform unsupervised learning. Once a pre-training step is done, network weights are fine-tuned using regular error back propagation while treating network as a feed-forward net. In the current paper we perform the comparison of described approach and commonly used classification approaches on some well-known classification data sets from the UCI repository as well as on one mid-sized proprietary data set.

Date: 2013
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/itms-2013-0009 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:itmasc:v:16:y:2013:i:1:p:60-65:n:9

DOI: 10.2478/itms-2013-0009

Access Statistics for this article

Information Technology and Management Science is currently edited by J. Merkurjevs

More articles in Information Technology and Management Science from Sciendo
Bibliographic data for series maintained by Peter Golla ().