Wolfgang Lãhr and
Nihat Ay Additional contact information Wolfgang Lãhr: Max Planck Institute for Mathematics in the Sciences, InselstraÃe 22, D-04103 Leipzig, Germany
Nihat Ay: Max Planck Institute for Mathematics in the Sciences, InselstraÃe 22, D-04103 Leipzig, Germany; Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, New Mexico 87501, USA
Abstract:
Given an observed stochastic process, computational mechanics provides an explicit and efficient method of constructing a minimal hidden Markov model within the class of maximally predictive models. Here, the corresponding so-called ε-machine encodes the mechanisms of prediction. We propose an alternative notion of predictive models in terms of a hidden Markov model capable of generating the underlying stochastic process. A comparison of these two notions of prediction reveals that our approach is less restrictive and thereby allows for predictive models that are more concise than the ε-machine.