Thinking outside the box: Statistical inference based on Kullback-Leibler empirical projections

Kjell Doksum, Akichika Ozeki, Jihoon Kim and Elias Chaibub Neto

Statistics & Probability Letters, 2007, vol. 77, issue 12, 1201-1213

Abstract: Suppose that X is a random vector with probability distribution P and suppose that denotes a proposed model that involves interesting parameters and relationship between variables. We consider statistical inference procedures for the case where constructed as follows: let [theta](P) denote the parameter of the distribution that minimizes a Kullback-Leibler (K-L)-type discrepancy K(Q,P) between Q and P. We take [theta](P) to be the parameter of interest. The estimate of [theta](P), when it exists, is defined by where is the empirical probability. We call a Kullback-Leibler empirical projection (KLEP). When does not exist, we extend the concept of a K-L discrepancy to limits of empirical likelihoods to obtain KLEP procedures. Properties of inference procedures based on are considered when . In particular we compare the naive procedure that uses the standard error applicable when , the sandwich formula standard error, and the bootstrap standard error using asymptotic methods and Monte Carlo simulation. For regression experiments with a model based on transforming both response and covariates, we use results of Hernandez and Johnson [1980. The large-sample behavior of transformations to normality. J. Amer. Statist. Assoc. 75, 855-861] to derive KLEP procedures.

Keywords: KLEP; Box-Cox; transformation; Outside; the; box; K-L; divergence; Sandwich; formula; Bootstrap; Classification; Covariate; transformations (search for similar items in EconPapers)
Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167-7152(07)00084-3
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:stapro:v:77:y:2007:i:12:p:1201-1213

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Statistics & Probability Letters is currently edited by Somnath Datta and Hira L. Koul

More articles in Statistics & Probability Letters from Elsevier
Bibliographic data for series maintained by Catherine Liu ().