Evaluating Neural Network Predictors by Bootstrapping (with A. Weigend)

Blake Lebaron ()

Working papers from University of Wisconsin - Madison

Abstract: We present a new method, inspired by the bootstrap, whose goal it is to determine the quality and reliability of a neural network predictor. Our method leads to more robust forecasting along with a large amount of statistical information on forecast performance that we exploit. We exhibit the method in the context of multi-variate time series prediction on financial data from the New York Stock Exchange. It turns out that the variation due to different resamplings (i.e., splits between training, cross-validation, and test sets) is significantly larger than the variation due to different network conditions (such as architecture, initial weights, etc.). Furthermore, this method allows us to forecast a probability distribution, as opposed to the traditional case of just a single value at each time step. We demonstrate this on a strictly held-out test set that includes the 1987 stock market crash. Finally, we compare the performance of the class of neural networks to a similarly bootstrapped linear model.

References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.econ.wisc.edu/~blake/papers/ssri9447.ps (application/postscript)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://www.econ.wisc.edu/~blake/papers/ssri9447.ps [301 Moved Permanently]--> https://www.econ.wisc.edu:443/~blake/papers/ssri9447.ps [301 Moved Permanently]--> https://econ.wisc.edu/~blake/papers/ssri9447.ps)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wop:wimahp:_003

Access Statistics for this paper

More papers in Working papers from University of Wisconsin - Madison Contact information at EDIRC.
Bibliographic data for series maintained by Thomas Krichel ().