SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNING

James P. Crutchfield () and David P. Feldman ()
Additional contact information
James P. Crutchfield: Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA
David P. Feldman: Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA;

Advances in Complex Systems (ACS), 2001, vol. 04, issue 02n03, 251-264

Abstract: Using an information-theoretic framework, we examine how an intelligent agent, given an accurate model of its environment, synchronizes to the environment — i.e., comes to know in which state the environment is. We show that the total uncertainty experienced by the agent during the process is closely related to the transient information, a new quantity that captures the manner in which the environment's entropy growth curve converges to its asymptotic form. We also discuss how an agent's estimates of its environment's structural properties are related to its estimate of the environment entropy rate. If structural properties are ignored, the missed regularities are converted to apparent randomness. Conversely, using representations that assume too much memory results in false predictability.

Keywords: Synchronization; agent; transient information; excess entropy; 02.50.Ey; 05.45.-a; 05.45.Tp; 89.75.Kd (search for similar items in EconPapers)
Date: 2001
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S021952590100019X
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:acsxxx:v:04:y:2001:i:02n03:n:s021952590100019x

Ordering information: This journal article can be ordered from

DOI: 10.1142/S021952590100019X

Access Statistics for this article

Advances in Complex Systems (ACS) is currently edited by Frank Schweitzer

More articles in Advances in Complex Systems (ACS) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().