Least Squares and Entropy: A Penalty Function Perspective

Paul Preckel ()

American Journal of Agricultural Economics, 2001, vol. 83, issue 2, 366-377

Abstract: Mathematical measures of entropy as defined by Shannon and cross entropy as defined by Kullback and Leibler are currently in vogue in the field of econometrics, primarily due to the comprehensive work of Golan, Judge, and Miller. An alternative interpretation of the entropy measure as a penalty function over deviations is presented, and a number of parallels are drawn with least squares estimators. It is demonstrated that both approaches may be applied to the general linear model. The causes of differences in estimated parameter values are described, and some suggestions for the formulation of entropy-based econometric problems are presented. Copyright 2001, Oxford University Press.

Date: 2001
References: Add references at CitEc
Citations: View citations in EconPapers (24)

Downloads: (external link)
http://hdl.handle.net/10.1111/0002-9092.00162 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:ajagec:v:83:y:2001:i:2:p:366-377

Access Statistics for this article

American Journal of Agricultural Economics is currently edited by Madhu Khanna, Brian E. Roe, James Vercammen and JunJie Wu

More articles in American Journal of Agricultural Economics from Agricultural and Applied Economics Association Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press ().