Prediction Variance and Information Worth of Observations in Time Series

Mohsen Pourahmadi and E. S. Soofi

Journal of Time Series Analysis, 2000, vol. 21, issue 4, 413-434

Abstract: The problem of developing measures of worth of observations in time series has not received much attention in the literature. Any meaningful measure of worth should naturally depend on the position of the observation as well as the objectives of the analysis, namely parameter estimation or prediction of future values. We introduce a measure that quantifies worth of a set of observations for the purpose of prediction of outcomes of stationary processes. The worth is measured as the change in the information content of the entire past due to exclusion or inclusion of a set of observations. The information content is quantified by the mutual information, which is the information theoretic measure of dependency. For Gaussian processes, the measure of worth turns out to be the relative change in the prediction error variance due to exclusion or inclusion of a set of observations. We provide formulae for computing predictive worth of a set of observations for Gaussian autoregressive moving‐average processs. For non‐Gaussian processes, however, a simple function of its entropy provides a lower bound for the variance of prediction error in the same manner that Fisher information provides a lower bound for the variance of an unbiased estimator via the Cramer‐Rao inequality. Statistical estimation of this lower bound requires estimation of the entropy of a stationary time series.

Date: 2000
References: Add references at CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
https://doi.org/10.1111/1467-9892.00191

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jtsera:v:21:y:2000:i:4:p:413-434

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0143-9782

Access Statistics for this article

Journal of Time Series Analysis is currently edited by M.B. Priestley

More articles in Journal of Time Series Analysis from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().