Evaluating Neural Network Predictors by Bootstrapping

Blake Lebaron () and Andreas S. Weigend
Additional contact information
Andreas S. Weigend: University of Colorado

Finance from University Library of Munich, Germany

Abstract: We present a new method, inspired by the bootstrap, whose goal it is to determine the quality and reliability of a neural network predictor. Our method leads to more robust forecasting along with a large amount of statistical information on forecast performance that we exploit. We exhibit the method in the context of multi-variate time series prediction on financial data from the New York Stock Exchange. It turns out that the variation due to different resamplings (i.e., splits between training, cross-validation, and test sets) is significantly larger than the variation due to different network conditions (such as architecture and initial weights). Furthermore, this method allows us to forecast a probability distribution, as opposed to the traditional case of just a single value at each time step. We demonstrate this on a strictly held-out test set that includes the 1987 stock market crash. We also compare the performance of the class of neural networks to identically bootstrapped linear models.

JEL-codes: G (search for similar items in EconPapers)
Date: 1994-11-14
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://econwpa.ub.uni-muenchen.de/econ-wp/fin/papers/9411/9411002.pdf (application/pdf)
https://econwpa.ub.uni-muenchen.de/econ-wp/fin/papers/9411/9411002.ps.gz (application/postscript)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wpa:wuwpfi:9411002

Access Statistics for this paper

More papers in Finance from University Library of Munich, Germany
Bibliographic data for series maintained by EconWPA ( this e-mail address is bad, please contact ).