Conditioning, Mutual Information, and Information Gain

Günther Palm
Additional contact information
Günther Palm: University of Ulm, Neural Information Processing

Chapter Chapter 11 in Novelty, Information and Surprise, 2012, pp 141-158 from Springer

Abstract: Abstract In this chapter we want to discuss the extension of three concepts of classical information theory, namely conditional information, transinformation (also called mutual information), and information gain (also called Kullback–Leibler distance) from descriptions to (reasonably large classes of) covers. This extension will also extend these concepts from discrete to continuous random variables.

Keywords: Mutual Information; Information Gain; Discrete Random Variable; Continuous Random Variable; Additive Symmetry (search for similar items in EconPapers)
Date: 2012
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-642-29075-6_11

Ordering information: This item can be ordered from
http://www.springer.com/9783642290756

DOI: 10.1007/978-3-642-29075-6_11

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().