Method of Empirical Means in Nonlinear Regression and Stochastic Optimization Models

Pavel S. Knopov () and Arnold S. Korkhin ()
Additional contact information
Pavel S. Knopov: National Academy of Science of Ukraine
Arnold S. Korkhin: National Mining University

Chapter Chapter 3 in Regression Analysis Under A Priori Parameter Restrictions, 2012, pp 73-120 from Springer

Abstract: Abstract In stochastic optimization and identification problems (Ermoliev and Wets 1988; Pflug 1996), it is not always possible to find the explicit extremum for the expectation of some random function. One of the methods for solving this problem is the method of empirical means, which consists in approximation of the existing cost function by its empiric estimate, for which one can solve the corresponding optimization problem. In addition, it is obvious that many problems in mathematical statistics (for example, estimation of unknown parameters by the least squares, the least modules, the maximum likelihood methods, etc.) can be formulated as special stochastic programming problems with specific constraints for unknown parameters which stresses the close relation between stochastic programming and estimation theory methods. In such problems the distributions of random variables or processes are often unknown, but their realizations are known. Therefore, one of the approaches for solving such problems consists in replacing the unknown distributions with empiric distributions, and replacing the corresponding mathematical expectations with their empiric means. The difficulty is in finding conditions under which the approximating problem converges in some probabilistic sense to the initial one. We discussed this briefly in Sect. 2.1. Convergence conditions are of course essentially dependent on the cost function, the probabilistic properties of random observations, metric properties of the space, in which the convergence is investigated, a priori constraints on unknown parameters, etc. In the notation used in statistical decision theory the problems above are closely related with the asymptotic properties of unknown parameters estimates, i.e. their consistency, asymptotic distribution, rate of convergence, etc.

Keywords: Unknown Parameter; Random Vector; Probability Space; Asymptotic Distribution; Minimum Point (search for similar items in EconPapers)
Date: 2012
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-1-4614-0574-0_3

Ordering information: This item can be ordered from
http://www.springer.com/9781461405740

DOI: 10.1007/978-1-4614-0574-0_3

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().