Locally regularised two-stage learning algorithm for RBF network centre selection

Jing Deng, Kang Li and George Irwin

International Journal of Systems Science, 2012, vol. 43, issue 6, 1157-1170

Abstract: Nonlinear system models constructed from radial basis function (RBF) networks can easily be over-fitted due to the noise on the data. While information criteria, such as the final prediction error (FPE), can provide a trade-off between training error and network complexity, the tunable parameters that penalise a large size of network model are hard to determine and are usually application dependent. This article introduces a new locally regularised, two-stage stepwise construction algorithm for RBF networks. The main objective is to produce a parsimonious network that generalises well over unseen data. This is achieved by utilising Bayesian learning within a two-stage stepwise construction procedure to penalise centres that are mainly interpreted by the noise. Specifically, each output layer weight is assigned a hyperparameter, a large value of such a parameter forcing the associated output layer weight to be near to zero. Sparsity is achieved by removing irrelevant RBF centres from the network. The efficacy of proposed algorithm from the original two-stage construction method is retained. Numerical analysis shows that this new method only needs about half of the computation involved in the locally regularised orthogonal least squares (LROLS) alternative. Results from two simulation examples are presented to show that the nonlinear system models resulting from this new approach are superior in terms of both sparsity and generalisation capability.

Date: 2012
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2010.545490 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:43:y:2012:i:6:p:1157-1170

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2010.545490

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().