New tools in non-linear modelling and prediction

Antonia Jones

Computational Management Science, 2004, vol. 1, issue 2, 109-149

Abstract: In this paper we give an account of a new change of perspective in non-linear modelling and prediction as applied to smooth systems. The core element of these developments is the Gamma test a non-linear modelling and analysis tool which allows us to examine the nature of a hypothetical input/output relationship in a numerical data-set. In essence, the Gamma test allows us to efficiently calculate that part of the variance of the output which cannot be accounted for by the existence of any smooth model based on the inputs, even though this model be unknown. A key aspect of this tool is its speed: the Gamma test has time complexity O( $M \log M$ ), where M is the number of data-points. For data-sets consisting of a few thousand points and a reasonable number of attributes, a single run of the Gamma test typically takes a few seconds. Around this essentially simple procedure a new set of analytical tools has evolved which allow us to model smooth non-linear systems directly from the data with a precision and confidence that hitherto was inaccessible. In this paper we briefly describe the Gamma test, its benefits in model identification and model building, and then in more detail explain and motivate the procedures which facilitate a Gamma analysis. We briefly report on a case study applying these ideas to the practical problem of predicting level and flow rates in the Thames valley river basin. Finally we speculate on the future development and enhancement of these techniques into areas such as datamining and the production of complex non-linear models directly from data via graphical representations of process charts and automated Gamma analysis of each input-output node. Copyright Springer-Verlag Berlin/Heidelberg 2004

Keywords: Gamma test; noise estimation; significant variable identification (search for similar items in EconPapers)
Date: 2004
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://hdl.handle.net/10.1007/s10287-003-0006-1 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:comgts:v:1:y:2004:i:2:p:109-149

Ordering information: This journal article can be ordered from
http://www.springer. ... ch/journal/10287/PS2

DOI: 10.1007/s10287-003-0006-1

Access Statistics for this article

Computational Management Science is currently edited by Ruediger Schultz

More articles in Computational Management Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().