Two Models of Information Costs Based on Computational Complexity

Mario Eboli

Computational Economics, 2003, vol. 21, issue 1_2, 87-105

Abstract: This work examines then computational cost of processing the information required by Bayesian updating of beliefs. The standard statistical approach adopted by economists, restricted to the exponential family, ignores these computational aspects. To fill this lacuna, two models of probabilistic reasoning are put forward: a model of associative memory and a well established tool of Artificial Intelligence called `Bayesian Networks'. These models are used to evaluate the time complexity and hence the computational cost. The associative memory model shows processing cost to be proportional to the entropy of the signal. This result is applied to classes of informationally equivalent signals to characterise the least expensive signals within the class. The Bayesian Network Model comprises a graphical representation of the causal and/or probabilistic relations among the random variables that generate the signal. According to this model, the computational cost depends on the size and connectivity of the graphical structure. The belief that the cost of inference is monotonically increasing in its precision is shown incorrect.

Date: 2003
References: Add references at CitEc
Citations:

Downloads: (external link)
http://journals.kluweronline.com/issn/0927-7099/contents (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:compec:v:21:y:2003:i:1_2:p:87-105

Ordering information: This journal article can be ordered from
http://www.springer. ... ry/journal/10614/PS2

Access Statistics for this article

Computational Economics is currently edited by Hans Amman

More articles in Computational Economics from Springer, Society for Computational Economics Contact information at EDIRC.
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().