Two Models of Information Costs Based on Computational Complexity

Mario Eboli

Computational Economics, 2003, vol. 21, issue 1, 87-105

Abstract: This work examines then computational cost of processing the information required by Bayesian updating of beliefs. The standard statistical approach adopted by economists, restricted to the exponential family, ignores thesecomputational aspects. To fill this lacuna, two models of probabilisticreasoning are put forward: a model of associative memory and a well established tool of Artificial Intelligence called `Bayesian Networks'. These models are used to evaluate the time complexity and hence the computational cost. The associativememory model shows processing cost to be proportional to the entropy of the signal. This result is applied to classes of informationally equivalentsignals to characterise the least expensive signals within the class. TheBayesian Network Model comprises a graphical representation of the causaland/or probabilistic relations among the random variables that generate thesignal. According to this model, the computational cost depends on the sizeand connectivity of the graphical structure. The belief that the cost ofinference is monotonically increasing in its precision is shown incorrect. Copyright Kluwer Academic Publishers 2003

Keywords: information costs; computational costs; belief updating; Turing machines; associetive memory; Bayesian networks (search for similar items in EconPapers)
Date: 2003
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1023/A:1022291016063 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:compec:v:21:y:2003:i:1:p:87-105

Ordering information: This journal article can be ordered from
http://www.springer. ... ry/journal/10614/PS2

DOI: 10.1023/A:1022291016063

Access Statistics for this article

Computational Economics is currently edited by Hans Amman

More articles in Computational Economics from Springer, Society for Computational Economics Contact information at EDIRC.
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().