LEAST SQUARES AND ENTROPY AS PENALTY FUNCTIONS

Paul Preckel ()

No 28625, Staff Papers from Purdue University, Department of Agricultural Economics

Abstract: Mathematical measures of entropy as defined by Shannon (1948) and Kullback and Leibler (1951) are currently in vogue in the field of econometrics, primarily due to the comprehensive work by Golan, Judge, and Miller (1996). In this paper, an alternative interpretation of the entropy measure as a penalty function over deviations is presented. Using this interpretation, a number of parallels are drawn with least squares estimators, and it is demonstrated that, with a minor modification of the traditional least squares estimator, both approaches may be applied to the general linear model. The advantages and disadvantages of each approach are discussed, and a philosophical approach to the selection of estimation technique is suggested.

Keywords: Research; Methods/Statistical; Methods (search for similar items in EconPapers)
Pages: 13
Date: 1998
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://ageconsearch.umn.edu/record/28625/files/sp98-16.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ags:puaesp:28625

DOI: 10.22004/ag.econ.28625

Access Statistics for this paper

More papers in Staff Papers from Purdue University, Department of Agricultural Economics Contact information at EDIRC.
Bibliographic data for series maintained by AgEcon Search ().