Maximum Likelihood Method

Michael Zabarankin and Stan Uryasev
Additional contact information
Michael Zabarankin: Stevens Institute of Technology
Stan Uryasev: University of Florida

Chapter Chapter 4 in Statistical Decision Problems, 2014, pp 45-52 from Springer

Abstract: Abstract A classical problem in the statistical decision theory is to estimate the probability distribution of a random vector X given its independent observations $$x_{1},\ldots,x_{n}$$ . Often it is assumed that the probability distribution comes from some family of functions parametrized by a set of parameters $$\theta _{1},\ldots,\theta _{m}$$ , so that in this case, the problem is reduced to estimating $$\theta _{1},\ldots,\theta _{m}$$ and is called parametric estimation. However, if no specific family of distributions is assumed, i.e., the probability distribution can not be completely defined by a finite number of parameters, the problem is called nonparametric estimation. In both parametric and nonparametric estimations, there are several approaches to determine the probability distribution in question: the maximum likelihood principle, maximum entropy principle, and the minimum relative entropy principle (or the principle of minimum discrimination information). These principles are closely related and are the subject of this chapter and the next one.

Keywords: Probability Distribution; Lagrange Multiplier; Random Vector; Maximum Likelihood Estimator; Nonparametric Estimation (search for similar items in EconPapers)
Date: 2014
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-1-4614-8471-4_4

Ordering information: This item can be ordered from
http://www.springer.com/9781461484714

DOI: 10.1007/978-1-4614-8471-4_4

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().