Adaptive self-tuning neurocontrol

Primož Potočnik and Igor Grabec

Mathematics and Computers in Simulation (MATCOM), 2000, vol. 51, issue 3, 201-207

Abstract: A novel approach to adaptive direct neurocontrol is discussed in this paper. The objective is to construct an adaptive control scheme for unknown time-dependent nonlinear plants without using a model of the plant. The proposed approach is neural-network based and combines the self-tuning principle with reinforcement learning. The control scheme consists of a controller, a utility estimator, an exploration module, a learning module and a rewarding module. The controller and the utility estimator are implemented together in a single radial basis function network. The learning method involves structural adaptation (growing neural network) and parameter adaptation. No prior knowledge of the plant is assumed, and the controller has to begin with exploration of the state space. The exploration–exploitation dilemma is solved through smooth transitions between the two modes. This enables rapid exploration response to novel plant dynamics and stable operation in the absence of changes in plant dynamics. The controller is capable of asymptotically approaching the desired reference trajectory, which is demonstrated in a simulation study.

Keywords: Neural networks; Adaptive control; Self-tuning; Reinforcement learning; Exploration; Radial basis function network (search for similar items in EconPapers)
Date: 2000
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378475499001172
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:51:y:2000:i:3:p:201-207

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().