Entropy and Cross Entropy: Characterizations and Applications

C. R. Rao ()
Additional contact information
C. R. Rao: University of Hyderabad campus, Advanced Institute of Mathematics, Statistics, and Computer Science

A chapter in The Legacy of Alladi Ramakrishnan in the Mathematical Sciences, 2010, pp 359-367 from Springer

Abstract: Summary The paper provides an axiomatic setup for an entropy function as a measure of diversity. A general definition of cross entropy is given and its use in solving a variety of stochastic and nonstochastic optimization problems is mentioned. A method of deriving a cross entropy function associated with a given entropy function is given.

Keywords: Cross entropy; Diversity; Decomposition of diversity; Kullback–Leibler divergence; Maximum entropy principle; Shannon entropy (search for similar items in EconPapers)
Date: 2010
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-1-4419-6263-8_22

Ordering information: This item can be ordered from
http://www.springer.com/9781441962638

DOI: 10.1007/978-1-4419-6263-8_22

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().