 Some Notes on Mutual Information Between Past and FutureLei M. Li Journal of Time Series Analysis, 2006, vol. 27, issue 2, 309-322 Abstract: Abstract. We present some new results on the mutual information between past and future for Gaussian stationary sequences. We provide several formulae to calculate this quantity. As a by‐product, we establish the so‐called reflectrum identity that links partial autocorrelation coefficients and cepstrum coefficients. So as to obtain these results, we provide an account of several regularity conditions for Gaussian stationary processes in terms of properties of the associated Toeplitz and Hankel operators. We discuss conditions under which the mutual information is finite. These results lead us to an interesting perspective towards the definition of long‐memory processes. Our result implies that zeros on the unit circle can cause mutual information to be infinite. Examples include fractional autoregressive integrated moving average (ARIMA) models. In addition, we consider a finite sample from a Gaussian stationary sequence. In the expansion of the determinant of its covariance matrix, the Toeplitz matrix, the first and second term are, entropy and mutual information respectively. A form of approximation to the likelihood using entropy and mutual information is presented. Date: 2006 Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:bla:jtsera:v:27:y:2006:i:2:p:309-322 Ordering information: This journal article can be ordered from Access Statistics for this article Journal of Time Series Analysis is currently edited by M.B. Priestley More articles in Journal of Time Series Analysis from Wiley Blackwell |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.