Entropy Maximization

Michael Zabarankin and Stan Uryasev
Additional contact information
Michael Zabarankin: Stevens Institute of Technology
Stan Uryasev: University of Florida

Chapter Chapter 5 in Statistical Decision Problems, 2014, pp 53-70 from Springer

Abstract: Abstract The previous chapter showed that given independent observations of a random variable X, the probability distribution of X can be estimated based on the maximum likelihood principle. However, if no observations of X are available, but some integral characteristics of the distribution of X are known, for example, mean μ and standard deviation σ, the main principle for finding the distribution in question is, arguably, the one of maximum entropy. This principle, also known as MaxEnt, originated from the information theory and statistical mechanics (see [22]) and determines the “most unbiased” probability distribution for X subject to any constraints on X (prior information). Nowadays, it is widely used in financial engineering and statistical decision problems [4, 11, 56]. Estimation of probability distributions through entropy maximization and through relative entropy minimization subject to various constraints on unknown distributions is the subject of this chapter.

Keywords: Entropy Maximization; Shannon Entropy; Mean Absolute Deviation; Renyi Entropy; Collateralized Debt Obligation (search for similar items in EconPapers)
Date: 2014
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-1-4614-8471-4_5

Ordering information: This item can be ordered from
http://www.springer.com/9781461484714

DOI: 10.1007/978-1-4614-8471-4_5

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().